Nov 27 03:13:38 user nova-compute[75006]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75006) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 03:13:38 user nova-compute[75006]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75006) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 03:13:38 user nova-compute[75006]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75006) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 03:13:38 user nova-compute[75006]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 27 03:13:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:13:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:13:38 user nova-compute[75006]: INFO nova.virt.driver [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 27 03:13:38 user nova-compute[75006]: INFO nova.compute.provider_config [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] Acquiring lock "singleton_lock" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] Acquired lock "singleton_lock" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] Releasing lock "singleton_lock" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] Full set of CONF: {{(pid=75006) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ******************************************************************************** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] Configuration options gathered from: {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ================================================================================ {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] allow_resize_to_same_host      = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] arq_binding_timeout            = 300 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] backdoor_port                  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] backdoor_socket                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] block_device_allocate_retries  = 300 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] block_device_allocate_retries_interval = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cert                           = self.pem {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute_monitors               = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] config_dir                     = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] config_drive_format            = iso9660 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] config_source                  = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] console_host                   = user {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] control_exchange               = nova {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cpu_allocation_ratio           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] daemon                         = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] debug                          = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] default_access_ip_network_name = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] default_availability_zone      = nova {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] default_ephemeral_format       = ext4 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] default_green_pool_size        = 1000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] default_schedule_zone          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] disk_allocation_ratio          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] enable_new_services            = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] enabled_apis                   = ['osapi_compute'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] enabled_ssl_apis               = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] flat_injected                  = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] force_config_drive             = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] force_raw_images               = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] graceful_shutdown_timeout      = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] heal_instance_info_cache_interval = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] host                           = user {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] instance_build_timeout         = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] instance_delete_interval       = 300 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] instance_format                = [instance: %(uuid)s]  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] instance_name_template         = instance-%08x {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] instance_usage_audit           = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] instance_usage_audit_period    = month {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] internal_service_availability_zone = internal {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] key                            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] live_migration_retry_count     = 30 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] log_config_append              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] log_dir                        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] log_file                       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] log_options                    = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] log_rotate_interval            = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] log_rotate_interval_type       = days {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] log_rotation_type              = none {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] long_rpc_timeout               = 1800 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] max_concurrent_builds          = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] max_concurrent_live_migrations = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] max_concurrent_snapshots       = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] max_local_block_devices        = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] max_logfile_count              = 30 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] max_logfile_size_mb            = 200 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] maximum_instance_delete_attempts = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] metadata_listen                = 0.0.0.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] metadata_listen_port           = 8775 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] metadata_workers               = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] migrate_max_retries            = -1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] mkisofs_cmd                    = genisoimage {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] my_ip                          = 10.0.0.210 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] network_allocate_retries       = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] osapi_compute_listen_port      = 8774 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] osapi_compute_unique_server_name_scope =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] osapi_compute_workers          = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] password_length                = 12 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] periodic_enable                = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] periodic_fuzzy_delay           = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] pointer_model                  = ps2mouse {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] preallocate_images             = none {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] publish_errors                 = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] pybasedir                      = /opt/stack/nova {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ram_allocation_ratio           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] rate_limit_burst               = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] rate_limit_except_level        = CRITICAL {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] rate_limit_interval            = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] reboot_timeout                 = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] reclaim_instance_interval      = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] record                         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] reimage_timeout_per_gb         = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] report_interval                = 120 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] rescue_timeout                 = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] reserved_host_cpus             = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] reserved_host_disk_mb          = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] reserved_host_memory_mb        = 512 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] reserved_huge_pages            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] resize_confirm_window          = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] resize_fs_using_block_device   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] resume_guests_state_on_host_boot = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] rpc_response_timeout           = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] run_external_periodic_tasks    = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] running_deleted_instance_action = reap {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] running_deleted_instance_poll_interval = 1800 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] running_deleted_instance_timeout = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler_instance_sync_interval = 120 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_down_time              = 720 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] servicegroup_driver            = db {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] shelved_offload_time           = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] shelved_poll_interval          = 3600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] shutdown_timeout               = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] source_is_ipv6                 = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ssl_only                       = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] state_path                     = /opt/stack/data/nova {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] sync_power_state_interval      = 600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] sync_power_state_pool_size     = 1000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] syslog_log_facility            = LOG_USER {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] tempdir                        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] timeout_nbd                    = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] transport_url                  = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] update_resources_interval      = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] use_cow_images                 = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] use_eventlog                   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] use_journal                    = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] use_json                       = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] use_rootwrap_daemon            = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] use_stderr                     = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] use_syslog                     = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vcpu_pin_set                   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plugging_is_fatal          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plugging_timeout           = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] virt_mkfs                      = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] volume_usage_poll_interval     = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] watch_log_file                 = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] web                            = /usr/share/spice-html5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_concurrency.disable_process_locking = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.auth_strategy              = keystone {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.compute_link_prefix        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.dhcp_domain                = novalocal {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.enable_instance_password   = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.glance_link_prefix         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.instance_list_per_project_cells = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.list_records_by_skipping_down_cells = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.local_metadata_per_cell    = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.max_limit                  = 1000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.metadata_cache_expiration  = 15 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.neutron_default_tenant_id  = default {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.use_forwarded_for          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.use_neutron_default_nets   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.vendordata_dynamic_targets = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.vendordata_jsonfile_path   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.backend                  = dogpile.cache.memcached {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.backend_argument         = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.config_prefix            = cache.oslo {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.dead_timeout             = 60.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.debug_cache_backend      = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.enable_retry_client      = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.enable_socket_keepalive  = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.enabled                  = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.expiration_time          = 600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.hashclient_retry_attempts = 2 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_dead_retry      = 300 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_password        =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_pool_maxsize    = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_sasl_enabled    = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.memcache_username        =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.proxies                  = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.retry_attempts           = 2 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.retry_delay              = 0.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.socket_keepalive_count   = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.socket_keepalive_idle    = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.socket_keepalive_interval = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.tls_allowed_ciphers      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.tls_cafile               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.tls_certfile             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.tls_enabled              = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cache.tls_keyfile              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.auth_section            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.auth_type               = password {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.cafile                  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.certfile                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.collect_timing          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.cross_az_attach         = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.debug                   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.endpoint_template       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.http_retries            = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.insecure                = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.keyfile                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.os_region_name          = RegionOne {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.split_loggers           = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cinder.timeout                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.cpu_dedicated_set      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.cpu_shared_set         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.image_type_exclude_list = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.max_concurrent_disk_ops = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.max_disk_devices_to_attach = -1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.resource_provider_association_refresh = 300 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.shutdown_retry_interval = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] conductor.workers              = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] console.allowed_origins        = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] console.ssl_ciphers            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] console.ssl_minimum_version    = default {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] consoleauth.token_ttl          = 600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.cafile                  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.certfile                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.collect_timing          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.connect_retries         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.connect_retry_delay     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.endpoint_override       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.insecure                = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.keyfile                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.max_version             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.min_version             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.region_name             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.service_name            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.service_type            = accelerator {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.split_loggers           = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.status_code_retries     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.status_code_retry_delay = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.timeout                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] cyborg.version                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.backend               = sqlalchemy {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.connection            = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.connection_debug      = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.connection_parameters =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.connection_recycle_time = 3600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.connection_trace      = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.db_inc_retry_interval = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.db_max_retries        = 20 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.db_max_retry_interval = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.db_retry_interval     = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.max_overflow          = 50 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.max_pool_size         = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.max_retries           = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.mysql_wsrep_sync_wait = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.pool_timeout          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.retry_interval        = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.slave_connection      = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] database.sqlite_synchronous    = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.backend           = sqlalchemy {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.connection        = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.connection_debug  = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.connection_parameters =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.connection_recycle_time = 3600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.connection_trace  = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.db_inc_retry_interval = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.db_max_retries    = 20 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.db_max_retry_interval = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.db_retry_interval = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.max_overflow      = 50 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.max_pool_size     = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.max_retries       = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.pool_timeout      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.retry_interval    = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.slave_connection  = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] api_database.sqlite_synchronous = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] devices.enabled_mdev_types     = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ephemeral_storage_encryption.enabled = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.api_servers             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.cafile                  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.certfile                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.collect_timing          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.connect_retries         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.connect_retry_delay     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.debug                   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.default_trusted_certificate_ids = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.enable_certificate_validation = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.enable_rbd_download     = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.endpoint_override       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.insecure                = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.keyfile                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.max_version             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.min_version             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.num_retries             = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.rbd_ceph_conf           =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.rbd_connect_timeout     = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.rbd_pool                =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.rbd_user                =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.region_name             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.service_name            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.service_type            = image {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.split_loggers           = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.status_code_retries     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.status_code_retry_delay = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.timeout                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.verify_glance_signatures = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] glance.version                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] guestfs.debug                  = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.config_drive_cdrom      = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.config_drive_inject_password = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.enable_instance_metrics_collection = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.enable_remotefx         = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.instances_path_share    =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.iscsi_initiator_list    = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.limit_cpu_features      = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.power_state_check_timeframe = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.use_multipath_io        = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.volume_attach_retry_count = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.vswitch_name            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] mks.enabled                    = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] image_cache.manager_interval   = 2400 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] image_cache.precache_concurrency = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] image_cache.remove_unused_base_images = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] image_cache.subdirectory_name  = _base {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.api_max_retries         = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.api_retry_interval      = 2 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.auth_section            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.auth_type               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.cafile                  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.certfile                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.collect_timing          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.conductor_group         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.connect_retries         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.connect_retry_delay     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.endpoint_override       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.insecure                = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.keyfile                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.max_version             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.min_version             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.peer_list               = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.region_name             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.serial_console_state_timeout = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.service_name            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.service_type            = baremetal {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.split_loggers           = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.status_code_retries     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.status_code_retry_delay = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.timeout                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ironic.version                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] key_manager.fixed_key          = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.barbican_api_version  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.barbican_endpoint     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.barbican_endpoint_type = public {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.barbican_region_name  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.cafile                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.certfile              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.collect_timing        = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.insecure              = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.keyfile               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.number_of_retries     = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.retry_delay           = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.send_service_user_token = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.split_loggers         = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.timeout               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.verify_ssl            = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican.verify_ssl_path       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.auth_section = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.auth_type = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.cafile   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.certfile = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.collect_timing = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.insecure = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.keyfile  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.split_loggers = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] barbican_service_user.timeout  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.approle_role_id          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.approle_secret_id        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.cafile                   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.certfile                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.collect_timing           = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.insecure                 = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.keyfile                  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.kv_mountpoint            = secret {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.kv_path                  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.kv_version               = 2 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.namespace                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.root_token_id            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.split_loggers            = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.ssl_ca_crt_file          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.timeout                  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.use_ssl                  = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.auth_section          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.auth_type             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.cafile                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.certfile              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.collect_timing        = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.connect_retries       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.connect_retry_delay   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.endpoint_override     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.insecure              = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.keyfile               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.max_version           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.min_version           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.region_name           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.service_name          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.service_type          = identity {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.split_loggers         = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.status_code_retries   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.status_code_retry_delay = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.timeout               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] keystone.version               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.connection_uri         =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.cpu_mode               = custom {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: WARNING oslo_config.cfg [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.cpu_power_governor_high = performance {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.cpu_power_governor_low = powersave {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.cpu_power_management   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.device_detach_attempts = 8 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.device_detach_timeout  = 20 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.disk_cachemodes        = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.disk_prefix            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.enabled_perf_events    = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.file_backed_memory     = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.gid_maps               = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.hw_disk_discard        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.hw_machine_type        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.images_rbd_glance_store_name =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.images_rbd_pool        = rbd {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.images_type            = default {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.images_volume_group    = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.inject_key             = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.inject_partition       = -2 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.inject_password        = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.iscsi_iface            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.iser_use_multipath     = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_bandwidth = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_downtime = 500 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_inbound_addr = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_permit_post_copy = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_scheme  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_timeout_action = abort {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_tunnelled = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: WARNING oslo_config.cfg [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 27 03:13:39 user nova-compute[75006]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 27 03:13:39 user nova-compute[75006]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 27 03:13:39 user nova-compute[75006]: and ``live_migration_inbound_addr`` respectively.
Nov 27 03:13:39 user nova-compute[75006]: ).  Its value may be silently ignored in the future.
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.live_migration_with_native_tls = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.max_queues             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.nfs_mount_options      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.num_memory_encrypted_guests = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.num_pcie_ports         = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.pmem_namespaces        = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.quobyte_client_cfg     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rbd_secret_uuid        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rbd_user               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.remote_filesystem_transport = ssh {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rescue_image_id        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rescue_kernel_id       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rescue_ramdisk_id      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.rx_queue_size          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.smbfs_mount_options    =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.snapshot_compression   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.snapshot_image_format  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.sparse_logical_volumes = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.swtpm_enabled          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.swtpm_group            = tss {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.swtpm_user             = tss {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.sysinfo_serial         = unique {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.tb_cache_size          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.tx_queue_size          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.uid_maps               = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.use_virtio_for_bridges = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.virt_type              = kvm {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.volume_clear           = zero {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.volume_clear_size      = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.volume_use_multipath   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.vzstorage_cache_path   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.vzstorage_mount_user   = stack {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.auth_section           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.auth_type              = password {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.cafile                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.certfile               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.collect_timing         = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.connect_retries        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.connect_retry_delay    = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.default_floating_pool  = public {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.endpoint_override      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.extension_sync_interval = 600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.http_retries           = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.insecure               = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.keyfile                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.max_version            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.min_version            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.ovs_bridge             = br-int {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.physnets               = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.region_name            = RegionOne {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.service_metadata_proxy = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.service_name           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.service_type           = network {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.split_loggers          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.status_code_retries    = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.status_code_retry_delay = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.timeout                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] neutron.version                = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] notifications.bdms_in_notifications = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] notifications.default_level    = INFO {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] notifications.notification_format = unversioned {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] notifications.notify_on_state_change = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] pci.alias                      = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] pci.device_spec                = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] pci.report_in_placement        = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.auth_section         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.auth_type            = password {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.cafile               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.certfile             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.collect_timing       = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.connect_retries      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.connect_retry_delay  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.default_domain_id    = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.default_domain_name  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.domain_id            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.domain_name          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.endpoint_override    = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.insecure             = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.keyfile              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.max_version          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.min_version          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.password             = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.project_domain_id    = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.project_domain_name  = Default {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.project_id           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.project_name         = service {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.region_name          = RegionOne {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.service_name         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.service_type         = placement {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.split_loggers        = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.status_code_retries  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.status_code_retry_delay = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.system_scope         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.timeout              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.trust_id             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.user_domain_id       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.user_domain_name     = Default {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.user_id              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.username             = placement {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] placement.version              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.cores                    = 20 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.count_usage_from_placement = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.injected_file_content_bytes = 10240 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.injected_file_path_length = 255 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.injected_files           = 5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.instances                = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.key_pairs                = 100 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.metadata_items           = 128 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.ram                      = 51200 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.recheck_quota            = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.server_group_members     = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] quota.server_groups            = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] rdp.enabled                    = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.image_metadata_prefilter = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.max_attempts         = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.max_placement_results = 1000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.query_placement_for_image_type_support = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] scheduler.workers              = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.host_subset_size = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.isolated_hosts = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.isolated_images = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.pci_in_placement = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.track_instance_changes = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] metrics.required               = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] metrics.weight_multiplier      = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] metrics.weight_setting         = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] serial_console.enabled         = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] serial_console.port_range      = 10000:20000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] serial_console.serialproxy_port = 6083 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.auth_section      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.auth_type         = password {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.cafile            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.certfile          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.collect_timing    = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.insecure          = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.keyfile           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.send_service_user_token = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.split_loggers     = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] service_user.timeout           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.agent_enabled            = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.enabled                  = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.html5proxy_port          = 6082 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.image_compression        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.jpeg_compression         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.playback_compression     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.server_listen            = 127.0.0.1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.streaming_mode           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] spice.zlib_compression         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] upgrade_levels.baseapi         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] upgrade_levels.compute         = auto {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] upgrade_levels.conductor       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] upgrade_levels.scheduler       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.auth_section = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.auth_type = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.cafile = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.certfile = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.insecure = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.keyfile = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vendordata_dynamic_auth.timeout = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.api_retry_count         = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.ca_file                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.cache_prefix            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.cluster_name            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.connection_pool_size    = 10 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.console_delay_seconds   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.datastore_regex         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.host_ip                 = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.host_password           = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.host_port               = 443 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.host_username           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.insecure                = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.integration_bridge      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.maximum_objects         = 100 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.pbm_default_policy      = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.pbm_enabled             = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.pbm_wsdl_location       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.serial_port_proxy_uri   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.serial_port_service_uri = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.task_poll_interval      = 0.5 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.use_linked_clone        = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.vnc_keymap              = en-us {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.vnc_port                = 5900 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vmware.vnc_port_total          = 10000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.auth_schemes               = ['none'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.enabled                    = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.novncproxy_port            = 6080 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.server_listen              = 0.0.0.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.vencrypt_ca_certs          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.vencrypt_client_cert       = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vnc.vencrypt_client_key        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.disable_rootwrap   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.enable_numa_live_migration = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.libvirt_disable_apic = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.client_socket_timeout     = 900 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.default_pool_size         = 1000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.keep_alive                = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.max_header_line           = 16384 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.ssl_ca_file               = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.ssl_cert_file             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.ssl_key_file              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.tcp_keepidle              = 600 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] zvm.ca_file                    = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] zvm.cloud_connector_url        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] zvm.reachable_timeout          = 300 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.enforce_new_defaults = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.enforce_scope      = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.policy_default_rule = default {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.policy_file        = policy.yaml {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.connection_string     = messaging:// {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.enabled               = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.es_doc_type           = notification {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.es_scroll_size        = 10000 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.es_scroll_time        = 2m {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.filter_error_trace    = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.hmac_keys             = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.sentinel_service_name = mymaster {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.socket_timeout        = 0.1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.trace_requests        = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler.trace_sqlalchemy      = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler_jaeger.process_tags   = {} {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler_jaeger.service_name_prefix = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] profiler_otlp.service_name_prefix = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] remote_debug.host              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] remote_debug.port              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.ssl      = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_notifications.retry = -1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_messaging_notifications.transport_url = **** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.auth_section        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.auth_type           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.cafile              = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.certfile            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.collect_timing      = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.connect_retries     = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.connect_retry_delay = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.endpoint_id         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.endpoint_override   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.insecure            = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.keyfile             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.max_version         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.min_version         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.region_name         = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.service_name        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.service_type        = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.split_loggers       = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.status_code_retries = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.status_code_retry_delay = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.timeout             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.valid_interfaces    = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_limit.version             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_reports.file_event_handler = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] oslo_reports.log_dir           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_ovs_privileged.group  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] vif_plug_ovs_privileged.user   = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_linux_bridge.flat_interface = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_ovs.isolate_vif         = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_vif_ovs.per_port_bridge     = False {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] os_brick.lock_path             = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] privsep_osbrick.capabilities   = [21] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] privsep_osbrick.group          = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] privsep_osbrick.helper_command = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] privsep_osbrick.user           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] nova_sys_admin.group           = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] nova_sys_admin.helper_command  = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] nova_sys_admin.user            = None {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG oslo_service.service [None req-d452df5f-584a-4844-9f65-91ade5708d9e None None] ******************************************************************************** {{(pid=75006) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 27 03:13:39 user nova-compute[75006]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 27 03:13:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Connecting to libvirt: qemu:///system {{(pid=75006) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd4452963e0> {{(pid=75006) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 27 03:13:39 user nova-compute[75006]: libvirt:  error : internal error: could not initialize domain event timer
Nov 27 03:13:39 user nova-compute[75006]: WARNING nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 27 03:13:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd4452963e0> {{(pid=75006) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Starting native event thread {{(pid=75006) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Starting green dispatch thread {{(pid=75006) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 27 03:13:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Starting connection event dispatch thread {{(pid=75006) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 27 03:13:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Connection event '1' reason 'None'
Nov 27 03:13:39 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 27 03:13:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.mount [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Initialising _HostMountState generation 0 {{(pid=75006) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 27 03:13:46 user nova-compute[75006]: INFO nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host capabilities <capabilities>
Nov 27 03:13:46 user nova-compute[75006]:   <host>
Nov 27 03:13:46 user nova-compute[75006]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 27 03:13:46 user nova-compute[75006]:     <cpu>
Nov 27 03:13:46 user nova-compute[75006]:       <arch>x86_64</arch>
Nov 27 03:13:46 user nova-compute[75006]:       <model>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:46 user nova-compute[75006]:       <microcode version='1070'/>
Nov 27 03:13:46 user nova-compute[75006]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 27 03:13:46 user nova-compute[75006]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='ss'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='vmx'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='pcid'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='osxsave'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='hypervisor'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='arat'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='tsc_adjust'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='md-clear'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='arch-capabilities'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='invtsc'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='rsba'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature name='skip-l1dfl-vmentry'/>
Nov 27 03:13:46 user nova-compute[75006]:       <pages unit='KiB' size='4'/>
Nov 27 03:13:46 user nova-compute[75006]:       <pages unit='KiB' size='2048'/>
Nov 27 03:13:46 user nova-compute[75006]:     </cpu>
Nov 27 03:13:46 user nova-compute[75006]:     <power_management>
Nov 27 03:13:46 user nova-compute[75006]:       <suspend_mem/>
Nov 27 03:13:46 user nova-compute[75006]:       <suspend_disk/>
Nov 27 03:13:46 user nova-compute[75006]:       <suspend_hybrid/>
Nov 27 03:13:46 user nova-compute[75006]:     </power_management>
Nov 27 03:13:46 user nova-compute[75006]:     <iommu support='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     <migration_features>
Nov 27 03:13:46 user nova-compute[75006]:       <live/>
Nov 27 03:13:46 user nova-compute[75006]:       <uri_transports>
Nov 27 03:13:46 user nova-compute[75006]:         <uri_transport>tcp</uri_transport>
Nov 27 03:13:46 user nova-compute[75006]:         <uri_transport>rdma</uri_transport>
Nov 27 03:13:46 user nova-compute[75006]:       </uri_transports>
Nov 27 03:13:46 user nova-compute[75006]:     </migration_features>
Nov 27 03:13:46 user nova-compute[75006]:     <topology>
Nov 27 03:13:46 user nova-compute[75006]:       <cells num='2'>
Nov 27 03:13:46 user nova-compute[75006]:         <cell id='0'>
Nov 27 03:13:46 user nova-compute[75006]:           <memory unit='KiB'>8189224</memory>
Nov 27 03:13:46 user nova-compute[75006]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 27 03:13:46 user nova-compute[75006]:           <pages unit='KiB' size='2048'>0</pages>
Nov 27 03:13:46 user nova-compute[75006]:           <distances>
Nov 27 03:13:46 user nova-compute[75006]:             <sibling id='0' value='10'/>
Nov 27 03:13:46 user nova-compute[75006]:             <sibling id='1' value='20'/>
Nov 27 03:13:46 user nova-compute[75006]:           </distances>
Nov 27 03:13:46 user nova-compute[75006]:           <cpus num='6'>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 27 03:13:46 user nova-compute[75006]:           </cpus>
Nov 27 03:13:46 user nova-compute[75006]:         </cell>
Nov 27 03:13:46 user nova-compute[75006]:         <cell id='1'>
Nov 27 03:13:46 user nova-compute[75006]:           <memory unit='KiB'>8206460</memory>
Nov 27 03:13:46 user nova-compute[75006]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 27 03:13:46 user nova-compute[75006]:           <pages unit='KiB' size='2048'>0</pages>
Nov 27 03:13:46 user nova-compute[75006]:           <distances>
Nov 27 03:13:46 user nova-compute[75006]:             <sibling id='0' value='20'/>
Nov 27 03:13:46 user nova-compute[75006]:             <sibling id='1' value='10'/>
Nov 27 03:13:46 user nova-compute[75006]:           </distances>
Nov 27 03:13:46 user nova-compute[75006]:           <cpus num='6'>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 27 03:13:46 user nova-compute[75006]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 27 03:13:46 user nova-compute[75006]:           </cpus>
Nov 27 03:13:46 user nova-compute[75006]:         </cell>
Nov 27 03:13:46 user nova-compute[75006]:       </cells>
Nov 27 03:13:46 user nova-compute[75006]:     </topology>
Nov 27 03:13:46 user nova-compute[75006]:     <cache>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 27 03:13:46 user nova-compute[75006]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 27 03:13:46 user nova-compute[75006]:     </cache>
Nov 27 03:13:46 user nova-compute[75006]:     <secmodel>
Nov 27 03:13:46 user nova-compute[75006]:       <model>apparmor</model>
Nov 27 03:13:46 user nova-compute[75006]:       <doi>0</doi>
Nov 27 03:13:46 user nova-compute[75006]:     </secmodel>
Nov 27 03:13:46 user nova-compute[75006]:     <secmodel>
Nov 27 03:13:46 user nova-compute[75006]:       <model>dac</model>
Nov 27 03:13:46 user nova-compute[75006]:       <doi>0</doi>
Nov 27 03:13:46 user nova-compute[75006]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 27 03:13:46 user nova-compute[75006]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 27 03:13:46 user nova-compute[75006]:     </secmodel>
Nov 27 03:13:46 user nova-compute[75006]:   </host>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='alpha'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>clipper</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='armv6l'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>spitz</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>nuri</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>kzm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sx1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>z2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>tosa</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>n810</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>n800</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>terrier</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>midway</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>microbit</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>verdex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>highbank</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>akita</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>connex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>collie</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='armv7l'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>spitz</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>nuri</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>kzm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sx1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>z2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>tosa</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>n810</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>n800</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>terrier</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>midway</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>microbit</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>verdex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>highbank</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>akita</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>connex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>collie</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='aarch64'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>spitz</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>nuri</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>kzm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sx1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>z2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>tosa</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>n810</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>n800</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>terrier</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>midway</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>microbit</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>verdex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>raspi3b</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>highbank</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>akita</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>connex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>collie</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <acpi default='on' toggle='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='cris'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='i686'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>x-remote</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>isapc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>microvm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='kvm'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <pae/>
Nov 27 03:13:46 user nova-compute[75006]:       <nonpae/>
Nov 27 03:13:46 user nova-compute[75006]:       <acpi default='on' toggle='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:       <apic default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='m68k'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>an5206</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>q800</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>next-cube</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='microblaze'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='microblazeel'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='mips'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='16'>malta</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='mipsel'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='16'>malta</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='mips64'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='16'>malta</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>pica61</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>magnum</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='mips64el'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='16'>malta</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>pica61</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>magnum</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='16'>boston</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='ppc'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mac99</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>40p</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>taihu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='ppc64'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2048'>powernv9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>taihu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2048'>powernv10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>40p</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mac99</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2048'>powernv8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='ppc64le'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2048'>powernv9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>taihu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2048'>powernv10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>40p</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>mac99</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2048'>powernv8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='riscv32'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='8'>spike</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>opentitan</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='5'>sifive_u</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sifive_e</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='8'>virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='riscv64'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='8'>spike</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='5'>sifive_u</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>shakti_c</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sifive_e</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='8'>virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='s390x'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='sh4'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>shix</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>r2d</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='sh4eb'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>shix</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>r2d</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='sparc'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>SS-5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>SS-20</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>LX</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>SS-4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>SS-10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>Voyager</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='sparc64'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sun4u</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>niagara</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>sun4v</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='x86_64'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>64</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>x-remote</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='1'>isapc</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>microvm</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='kvm'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <acpi default='on' toggle='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:       <apic default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='xtensa'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>sim</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>kc705</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>ml605</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>lx200</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>lx60</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]:   <guest>
Nov 27 03:13:46 user nova-compute[75006]:     <os_type>hvm</os_type>
Nov 27 03:13:46 user nova-compute[75006]:     <arch name='xtensaeb'>
Nov 27 03:13:46 user nova-compute[75006]:       <wordsize>32</wordsize>
Nov 27 03:13:46 user nova-compute[75006]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='4'>sim</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>kc705</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>ml605</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>virt</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>lx200</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>lx60</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 27 03:13:46 user nova-compute[75006]:       <domain type='qemu'/>
Nov 27 03:13:46 user nova-compute[75006]:     </arch>
Nov 27 03:13:46 user nova-compute[75006]:     <features>
Nov 27 03:13:46 user nova-compute[75006]:       <cpuselection/>
Nov 27 03:13:46 user nova-compute[75006]:       <deviceboot/>
Nov 27 03:13:46 user nova-compute[75006]:       <disksnapshot default='on' toggle='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     </features>
Nov 27 03:13:46 user nova-compute[75006]:   </guest>
Nov 27 03:13:46 user nova-compute[75006]: </capabilities>
Nov 27 03:13:46 user nova-compute[75006]: 
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 27 03:13:46 user nova-compute[75006]: <domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 03:13:46 user nova-compute[75006]:   <domain>kvm</domain>
Nov 27 03:13:46 user nova-compute[75006]:   <machine>pc-q35-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:   <arch>i686</arch>
Nov 27 03:13:46 user nova-compute[75006]:   <vcpu max='288'/>
Nov 27 03:13:46 user nova-compute[75006]:   <iothreads supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:   <os supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='firmware'/>
Nov 27 03:13:46 user nova-compute[75006]:     <loader supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>rom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pflash</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='readonly'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='secure'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </loader>
Nov 27 03:13:46 user nova-compute[75006]:   </os>
Nov 27 03:13:46 user nova-compute[75006]:   <cpu>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-passthrough' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='hostPassthroughMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='maximum' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='maximumMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-model' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ss'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='vmx'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='pcid'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='hypervisor'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arat'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='umip'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='md-clear'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibpb'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibrs'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='erms'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='lm'/>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='custom' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>qemu64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>qemu32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>phenom</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>n270</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>kvm64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>kvm32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>coreduo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>core2duo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>athlon</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Westmere</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Snowridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Penryn</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G5</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G4</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G1</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Nehalem</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Rome</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Milan</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Dhyana</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cooperlake</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Conroe</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>486</model>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:   </cpu>
Nov 27 03:13:46 user nova-compute[75006]:   <memoryBacking supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='sourceType'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>file</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>anonymous</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>memfd</value>
Nov 27 03:13:46 user nova-compute[75006]:     </enum>
Nov 27 03:13:46 user nova-compute[75006]:   </memoryBacking>
Nov 27 03:13:46 user nova-compute[75006]:   <devices>
Nov 27 03:13:46 user nova-compute[75006]:     <disk supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='diskDevice'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>disk</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cdrom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>floppy</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>lun</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='bus'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>fdc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sata</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </disk>
Nov 27 03:13:46 user nova-compute[75006]:     <graphics supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sdl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vnc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>spice</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egl-headless</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </graphics>
Nov 27 03:13:46 user nova-compute[75006]:     <video supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='modelType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cirrus</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vmvga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>qxl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>none</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>bochs</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>ramfb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </video>
Nov 27 03:13:46 user nova-compute[75006]:     <hostdev supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='mode'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>subsystem</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='startupPolicy'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>default</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>mandatory</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>requisite</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>optional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='subsysType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pci</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='capsType'/>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='pciBackend'/>
Nov 27 03:13:46 user nova-compute[75006]:     </hostdev>
Nov 27 03:13:46 user nova-compute[75006]:     <rng supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>random</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egd</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>builtin</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </rng>
Nov 27 03:13:46 user nova-compute[75006]:     <filesystem supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='driverType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>path</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>handle</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtiofs</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </filesystem>
Nov 27 03:13:46 user nova-compute[75006]:     <tpm supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>tpm-tis</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>tpm-crb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>passthrough</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>emulator</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </tpm>
Nov 27 03:13:46 user nova-compute[75006]:   </devices>
Nov 27 03:13:46 user nova-compute[75006]:   <features>
Nov 27 03:13:46 user nova-compute[75006]:     <gic supported='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     <vmcoreinfo supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <genid supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <backingStoreInput supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <backup supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <sev supported='no'/>
Nov 27 03:13:46 user nova-compute[75006]:   </features>
Nov 27 03:13:46 user nova-compute[75006]: </domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:  {{(pid=75006) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 27 03:13:46 user nova-compute[75006]: <domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 03:13:46 user nova-compute[75006]:   <domain>kvm</domain>
Nov 27 03:13:46 user nova-compute[75006]:   <machine>pc-i440fx-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:   <arch>i686</arch>
Nov 27 03:13:46 user nova-compute[75006]:   <vcpu max='255'/>
Nov 27 03:13:46 user nova-compute[75006]:   <iothreads supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:   <os supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='firmware'/>
Nov 27 03:13:46 user nova-compute[75006]:     <loader supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>rom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pflash</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='readonly'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='secure'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </loader>
Nov 27 03:13:46 user nova-compute[75006]:   </os>
Nov 27 03:13:46 user nova-compute[75006]:   <cpu>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-passthrough' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='hostPassthroughMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='maximum' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='maximumMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-model' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ss'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='vmx'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='pcid'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='hypervisor'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arat'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='umip'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='md-clear'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibpb'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibrs'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='erms'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='lm'/>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='custom' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>qemu64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>qemu32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>phenom</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>n270</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>kvm64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>kvm32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>coreduo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>core2duo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>athlon</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Westmere</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Snowridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Penryn</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G5</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G4</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G1</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Nehalem</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Rome</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Milan</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Dhyana</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cooperlake</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Conroe</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>486</model>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:   </cpu>
Nov 27 03:13:46 user nova-compute[75006]:   <memoryBacking supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='sourceType'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>file</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>anonymous</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>memfd</value>
Nov 27 03:13:46 user nova-compute[75006]:     </enum>
Nov 27 03:13:46 user nova-compute[75006]:   </memoryBacking>
Nov 27 03:13:46 user nova-compute[75006]:   <devices>
Nov 27 03:13:46 user nova-compute[75006]:     <disk supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='diskDevice'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>disk</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cdrom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>floppy</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>lun</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='bus'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>ide</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>fdc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sata</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </disk>
Nov 27 03:13:46 user nova-compute[75006]:     <graphics supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sdl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vnc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>spice</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egl-headless</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </graphics>
Nov 27 03:13:46 user nova-compute[75006]:     <video supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='modelType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cirrus</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vmvga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>qxl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>none</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>bochs</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>ramfb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </video>
Nov 27 03:13:46 user nova-compute[75006]:     <hostdev supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='mode'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>subsystem</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='startupPolicy'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>default</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>mandatory</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>requisite</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>optional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='subsysType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pci</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='capsType'/>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='pciBackend'/>
Nov 27 03:13:46 user nova-compute[75006]:     </hostdev>
Nov 27 03:13:46 user nova-compute[75006]:     <rng supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>random</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egd</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>builtin</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </rng>
Nov 27 03:13:46 user nova-compute[75006]:     <filesystem supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='driverType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>path</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>handle</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtiofs</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </filesystem>
Nov 27 03:13:46 user nova-compute[75006]:     <tpm supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>tpm-tis</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>tpm-crb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>passthrough</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>emulator</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </tpm>
Nov 27 03:13:46 user nova-compute[75006]:   </devices>
Nov 27 03:13:46 user nova-compute[75006]:   <features>
Nov 27 03:13:46 user nova-compute[75006]:     <gic supported='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     <vmcoreinfo supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <genid supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <backingStoreInput supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <backup supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <sev supported='no'/>
Nov 27 03:13:46 user nova-compute[75006]:   </features>
Nov 27 03:13:46 user nova-compute[75006]: </domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:  {{(pid=75006) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 27 03:13:46 user nova-compute[75006]: <domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 03:13:46 user nova-compute[75006]:   <domain>kvm</domain>
Nov 27 03:13:46 user nova-compute[75006]:   <machine>pc-q35-jammy</machine>
Nov 27 03:13:46 user nova-compute[75006]:   <arch>i686</arch>
Nov 27 03:13:46 user nova-compute[75006]:   <vcpu max='288'/>
Nov 27 03:13:46 user nova-compute[75006]:   <iothreads supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:   <os supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='firmware'/>
Nov 27 03:13:46 user nova-compute[75006]:     <loader supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>rom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pflash</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='readonly'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='secure'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </loader>
Nov 27 03:13:46 user nova-compute[75006]:   </os>
Nov 27 03:13:46 user nova-compute[75006]:   <cpu>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-passthrough' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='hostPassthroughMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='maximum' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='maximumMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-model' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ss'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='vmx'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='pcid'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='hypervisor'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arat'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='umip'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='md-clear'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibpb'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibrs'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='erms'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='lm'/>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='custom' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>qemu64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>qemu32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>phenom</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>n270</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>kvm64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>kvm32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>coreduo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>core2duo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>athlon</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Westmere</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Snowridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Penryn</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G5</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G4</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G1</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Nehalem</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Rome</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Milan</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Dhyana</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cooperlake</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Conroe</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>486</model>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:   </cpu>
Nov 27 03:13:46 user nova-compute[75006]:   <memoryBacking supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='sourceType'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>file</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>anonymous</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>memfd</value>
Nov 27 03:13:46 user nova-compute[75006]:     </enum>
Nov 27 03:13:46 user nova-compute[75006]:   </memoryBacking>
Nov 27 03:13:46 user nova-compute[75006]:   <devices>
Nov 27 03:13:46 user nova-compute[75006]:     <disk supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='diskDevice'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>disk</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cdrom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>floppy</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>lun</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='bus'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>fdc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sata</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </disk>
Nov 27 03:13:46 user nova-compute[75006]:     <graphics supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sdl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vnc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>spice</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egl-headless</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </graphics>
Nov 27 03:13:46 user nova-compute[75006]:     <video supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='modelType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cirrus</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vmvga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>qxl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>none</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>bochs</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>ramfb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </video>
Nov 27 03:13:46 user nova-compute[75006]:     <hostdev supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='mode'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>subsystem</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='startupPolicy'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>default</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>mandatory</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>requisite</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>optional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='subsysType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pci</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='capsType'/>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='pciBackend'/>
Nov 27 03:13:46 user nova-compute[75006]:     </hostdev>
Nov 27 03:13:46 user nova-compute[75006]:     <rng supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>random</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egd</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>builtin</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </rng>
Nov 27 03:13:46 user nova-compute[75006]:     <filesystem supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='driverType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>path</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>handle</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtiofs</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </filesystem>
Nov 27 03:13:46 user nova-compute[75006]:     <tpm supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>tpm-tis</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>tpm-crb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>passthrough</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>emulator</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </tpm>
Nov 27 03:13:46 user nova-compute[75006]:   </devices>
Nov 27 03:13:46 user nova-compute[75006]:   <features>
Nov 27 03:13:46 user nova-compute[75006]:     <gic supported='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     <vmcoreinfo supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <genid supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <backingStoreInput supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <backup supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <sev supported='no'/>
Nov 27 03:13:46 user nova-compute[75006]:   </features>
Nov 27 03:13:46 user nova-compute[75006]: </domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:  {{(pid=75006) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 27 03:13:46 user nova-compute[75006]: <domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 03:13:46 user nova-compute[75006]:   <domain>kvm</domain>
Nov 27 03:13:46 user nova-compute[75006]:   <machine>pc-i440fx-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:   <arch>i686</arch>
Nov 27 03:13:46 user nova-compute[75006]:   <vcpu max='255'/>
Nov 27 03:13:46 user nova-compute[75006]:   <iothreads supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:   <os supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='firmware'/>
Nov 27 03:13:46 user nova-compute[75006]:     <loader supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>rom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pflash</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='readonly'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='secure'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </loader>
Nov 27 03:13:46 user nova-compute[75006]:   </os>
Nov 27 03:13:46 user nova-compute[75006]:   <cpu>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-passthrough' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='hostPassthroughMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='maximum' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='maximumMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-model' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ss'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='vmx'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='pcid'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='hypervisor'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arat'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='umip'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='md-clear'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibpb'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibrs'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='erms'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='lm'/>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='custom' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>qemu64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>qemu32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>phenom</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>n270</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>kvm64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>kvm32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>coreduo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>core2duo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>athlon</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Westmere</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Snowridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Penryn</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G5</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G4</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G1</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Nehalem</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Rome</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Milan</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Dhyana</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cooperlake</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Conroe</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>486</model>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:   </cpu>
Nov 27 03:13:46 user nova-compute[75006]:   <memoryBacking supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='sourceType'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>file</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>anonymous</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>memfd</value>
Nov 27 03:13:46 user nova-compute[75006]:     </enum>
Nov 27 03:13:46 user nova-compute[75006]:   </memoryBacking>
Nov 27 03:13:46 user nova-compute[75006]:   <devices>
Nov 27 03:13:46 user nova-compute[75006]:     <disk supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='diskDevice'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>disk</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cdrom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>floppy</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>lun</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='bus'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>ide</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>fdc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sata</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </disk>
Nov 27 03:13:46 user nova-compute[75006]:     <graphics supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sdl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vnc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>spice</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egl-headless</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </graphics>
Nov 27 03:13:46 user nova-compute[75006]:     <video supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='modelType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cirrus</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vmvga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>qxl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>none</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>bochs</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>ramfb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </video>
Nov 27 03:13:46 user nova-compute[75006]:     <hostdev supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='mode'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>subsystem</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='startupPolicy'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>default</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>mandatory</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>requisite</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>optional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='subsysType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pci</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='capsType'/>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='pciBackend'/>
Nov 27 03:13:46 user nova-compute[75006]:     </hostdev>
Nov 27 03:13:46 user nova-compute[75006]:     <rng supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>random</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egd</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>builtin</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </rng>
Nov 27 03:13:46 user nova-compute[75006]:     <filesystem supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='driverType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>path</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>handle</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtiofs</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </filesystem>
Nov 27 03:13:46 user nova-compute[75006]:     <tpm supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>tpm-tis</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>tpm-crb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>passthrough</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>emulator</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </tpm>
Nov 27 03:13:46 user nova-compute[75006]:   </devices>
Nov 27 03:13:46 user nova-compute[75006]:   <features>
Nov 27 03:13:46 user nova-compute[75006]:     <gic supported='no'/>
Nov 27 03:13:46 user nova-compute[75006]:     <vmcoreinfo supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <genid supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <backingStoreInput supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <backup supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:     <sev supported='no'/>
Nov 27 03:13:46 user nova-compute[75006]:   </features>
Nov 27 03:13:46 user nova-compute[75006]: </domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:  {{(pid=75006) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 27 03:13:46 user nova-compute[75006]: <domainCapabilities>
Nov 27 03:13:46 user nova-compute[75006]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 03:13:46 user nova-compute[75006]:   <domain>kvm</domain>
Nov 27 03:13:46 user nova-compute[75006]:   <machine>pc-q35-6.2</machine>
Nov 27 03:13:46 user nova-compute[75006]:   <arch>x86_64</arch>
Nov 27 03:13:46 user nova-compute[75006]:   <vcpu max='288'/>
Nov 27 03:13:46 user nova-compute[75006]:   <iothreads supported='yes'/>
Nov 27 03:13:46 user nova-compute[75006]:   <os supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='firmware'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>efi</value>
Nov 27 03:13:46 user nova-compute[75006]:     </enum>
Nov 27 03:13:46 user nova-compute[75006]:     <loader supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>rom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pflash</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='readonly'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='secure'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </loader>
Nov 27 03:13:46 user nova-compute[75006]:   </os>
Nov 27 03:13:46 user nova-compute[75006]:   <cpu>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-passthrough' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='hostPassthroughMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='maximum' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='maximumMigratable'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='host-model' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ss'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='vmx'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='pcid'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='hypervisor'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arat'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='umip'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='md-clear'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='invtsc'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibpb'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='ibrs'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-stibp'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='rsba'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='erms'/>
Nov 27 03:13:46 user nova-compute[75006]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:     <mode name='custom' supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>qemu64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>qemu32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>phenom</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>pentium</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>n270</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>kvm64</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>kvm32</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>coreduo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>core2duo</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>athlon</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>Westmere</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Snowridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Skylake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>SandyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>Penryn</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G5</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G4</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G3</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Opteron_G2</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>Opteron_G1</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>Nehalem</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>IvyBridge</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Icelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Haswell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Rome</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-Milan</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>EPYC</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Dhyana</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cooperlake</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>Conroe</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='no'>Broadwell</model>
Nov 27 03:13:46 user nova-compute[75006]:       <model usable='yes'>486</model>
Nov 27 03:13:46 user nova-compute[75006]:     </mode>
Nov 27 03:13:46 user nova-compute[75006]:   </cpu>
Nov 27 03:13:46 user nova-compute[75006]:   <memoryBacking supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:     <enum name='sourceType'>
Nov 27 03:13:46 user nova-compute[75006]:       <value>file</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>anonymous</value>
Nov 27 03:13:46 user nova-compute[75006]:       <value>memfd</value>
Nov 27 03:13:46 user nova-compute[75006]:     </enum>
Nov 27 03:13:46 user nova-compute[75006]:   </memoryBacking>
Nov 27 03:13:46 user nova-compute[75006]:   <devices>
Nov 27 03:13:46 user nova-compute[75006]:     <disk supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='diskDevice'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>disk</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cdrom</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>floppy</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>lun</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='bus'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>fdc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sata</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </disk>
Nov 27 03:13:46 user nova-compute[75006]:     <graphics supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>sdl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vnc</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>spice</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egl-headless</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </graphics>
Nov 27 03:13:46 user nova-compute[75006]:     <video supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='modelType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>cirrus</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>vmvga</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>qxl</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>none</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>bochs</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>ramfb</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </video>
Nov 27 03:13:46 user nova-compute[75006]:     <hostdev supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='mode'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>subsystem</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='startupPolicy'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>default</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>mandatory</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>requisite</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>optional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='subsysType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>pci</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='capsType'/>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='pciBackend'/>
Nov 27 03:13:46 user nova-compute[75006]:     </hostdev>
Nov 27 03:13:46 user nova-compute[75006]:     <rng supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>random</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>egd</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>builtin</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </rng>
Nov 27 03:13:46 user nova-compute[75006]:     <filesystem supported='yes'>
Nov 27 03:13:46 user nova-compute[75006]:       <enum name='driverType'>
Nov 27 03:13:46 user nova-compute[75006]:         <value>path</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>handle</value>
Nov 27 03:13:46 user nova-compute[75006]:         <value>virtiofs</value>
Nov 27 03:13:46 user nova-compute[75006]:       </enum>
Nov 27 03:13:46 user nova-compute[75006]:     </filesystem>
Nov 27 03:13:46 user nova-compute[75006]:     <tpm supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>tpm-tis</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>tpm-crb</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>passthrough</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>emulator</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </tpm>
Nov 27 03:13:47 user nova-compute[75006]:   </devices>
Nov 27 03:13:47 user nova-compute[75006]:   <features>
Nov 27 03:13:47 user nova-compute[75006]:     <gic supported='no'/>
Nov 27 03:13:47 user nova-compute[75006]:     <vmcoreinfo supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <genid supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <backingStoreInput supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <backup supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <sev supported='no'/>
Nov 27 03:13:47 user nova-compute[75006]:   </features>
Nov 27 03:13:47 user nova-compute[75006]: </domainCapabilities>
Nov 27 03:13:47 user nova-compute[75006]:  {{(pid=75006) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 27 03:13:47 user nova-compute[75006]: <domainCapabilities>
Nov 27 03:13:47 user nova-compute[75006]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 03:13:47 user nova-compute[75006]:   <domain>kvm</domain>
Nov 27 03:13:47 user nova-compute[75006]:   <machine>pc-i440fx-jammy</machine>
Nov 27 03:13:47 user nova-compute[75006]:   <arch>x86_64</arch>
Nov 27 03:13:47 user nova-compute[75006]:   <vcpu max='255'/>
Nov 27 03:13:47 user nova-compute[75006]:   <iothreads supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:   <os supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:     <enum name='firmware'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>efi</value>
Nov 27 03:13:47 user nova-compute[75006]:     </enum>
Nov 27 03:13:47 user nova-compute[75006]:     <loader supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>rom</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>pflash</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='readonly'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='secure'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </loader>
Nov 27 03:13:47 user nova-compute[75006]:   </os>
Nov 27 03:13:47 user nova-compute[75006]:   <cpu>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='host-passthrough' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='hostPassthroughMigratable'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='maximum' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='maximumMigratable'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='host-model' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ss'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='vmx'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='pcid'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='hypervisor'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='arat'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='umip'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='md-clear'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='stibp'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ssbd'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='invtsc'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ibpb'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ibrs'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='amd-stibp'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='rsba'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='disable' name='erms'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='custom' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>qemu64</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>qemu32</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>phenom</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium3</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium2</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>n270</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>kvm64</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>kvm32</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>coreduo</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>core2duo</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>athlon</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Westmere</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Snowridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>SandyBridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Penryn</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G5</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G4</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G3</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G2</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Opteron_G1</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Nehalem</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>IvyBridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Icelake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-Rome</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-Milan</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Dhyana</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cooperlake</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Conroe</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>486</model>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:   </cpu>
Nov 27 03:13:47 user nova-compute[75006]:   <memoryBacking supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:     <enum name='sourceType'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>file</value>
Nov 27 03:13:47 user nova-compute[75006]:       <value>anonymous</value>
Nov 27 03:13:47 user nova-compute[75006]:       <value>memfd</value>
Nov 27 03:13:47 user nova-compute[75006]:     </enum>
Nov 27 03:13:47 user nova-compute[75006]:   </memoryBacking>
Nov 27 03:13:47 user nova-compute[75006]:   <devices>
Nov 27 03:13:47 user nova-compute[75006]:     <disk supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='diskDevice'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>disk</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>cdrom</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>floppy</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>lun</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='bus'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>ide</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>fdc</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>sata</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </disk>
Nov 27 03:13:47 user nova-compute[75006]:     <graphics supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>sdl</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vnc</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>spice</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>egl-headless</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </graphics>
Nov 27 03:13:47 user nova-compute[75006]:     <video supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='modelType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vga</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>cirrus</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vmvga</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>qxl</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>none</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>bochs</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>ramfb</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </video>
Nov 27 03:13:47 user nova-compute[75006]:     <hostdev supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='mode'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>subsystem</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='startupPolicy'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>default</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>mandatory</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>requisite</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>optional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='subsysType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>pci</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='capsType'/>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='pciBackend'/>
Nov 27 03:13:47 user nova-compute[75006]:     </hostdev>
Nov 27 03:13:47 user nova-compute[75006]:     <rng supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>random</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>egd</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>builtin</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </rng>
Nov 27 03:13:47 user nova-compute[75006]:     <filesystem supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='driverType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>path</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>handle</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtiofs</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </filesystem>
Nov 27 03:13:47 user nova-compute[75006]:     <tpm supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>tpm-tis</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>tpm-crb</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>passthrough</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>emulator</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </tpm>
Nov 27 03:13:47 user nova-compute[75006]:   </devices>
Nov 27 03:13:47 user nova-compute[75006]:   <features>
Nov 27 03:13:47 user nova-compute[75006]:     <gic supported='no'/>
Nov 27 03:13:47 user nova-compute[75006]:     <vmcoreinfo supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <genid supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <backingStoreInput supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <backup supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <sev supported='no'/>
Nov 27 03:13:47 user nova-compute[75006]:   </features>
Nov 27 03:13:47 user nova-compute[75006]: </domainCapabilities>
Nov 27 03:13:47 user nova-compute[75006]:  {{(pid=75006) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 27 03:13:47 user nova-compute[75006]: <domainCapabilities>
Nov 27 03:13:47 user nova-compute[75006]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 03:13:47 user nova-compute[75006]:   <domain>kvm</domain>
Nov 27 03:13:47 user nova-compute[75006]:   <machine>pc-q35-jammy</machine>
Nov 27 03:13:47 user nova-compute[75006]:   <arch>x86_64</arch>
Nov 27 03:13:47 user nova-compute[75006]:   <vcpu max='288'/>
Nov 27 03:13:47 user nova-compute[75006]:   <iothreads supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:   <os supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:     <enum name='firmware'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>efi</value>
Nov 27 03:13:47 user nova-compute[75006]:     </enum>
Nov 27 03:13:47 user nova-compute[75006]:     <loader supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 27 03:13:47 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 27 03:13:47 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>rom</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>pflash</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='readonly'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='secure'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </loader>
Nov 27 03:13:47 user nova-compute[75006]:   </os>
Nov 27 03:13:47 user nova-compute[75006]:   <cpu>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='host-passthrough' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='hostPassthroughMigratable'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='maximum' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='maximumMigratable'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='host-model' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ss'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='vmx'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='pcid'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='hypervisor'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='arat'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='umip'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='md-clear'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='stibp'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ssbd'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='invtsc'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ibpb'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ibrs'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='amd-stibp'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='rsba'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='disable' name='erms'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='custom' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>qemu64</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>qemu32</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>phenom</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium3</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium2</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>n270</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>kvm64</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>kvm32</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>coreduo</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>core2duo</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>athlon</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Westmere</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Snowridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>SandyBridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Penryn</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G5</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G4</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G3</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G2</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Opteron_G1</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Nehalem</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>IvyBridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Icelake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-Rome</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-Milan</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Dhyana</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cooperlake</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Conroe</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>486</model>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:   </cpu>
Nov 27 03:13:47 user nova-compute[75006]:   <memoryBacking supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:     <enum name='sourceType'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>file</value>
Nov 27 03:13:47 user nova-compute[75006]:       <value>anonymous</value>
Nov 27 03:13:47 user nova-compute[75006]:       <value>memfd</value>
Nov 27 03:13:47 user nova-compute[75006]:     </enum>
Nov 27 03:13:47 user nova-compute[75006]:   </memoryBacking>
Nov 27 03:13:47 user nova-compute[75006]:   <devices>
Nov 27 03:13:47 user nova-compute[75006]:     <disk supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='diskDevice'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>disk</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>cdrom</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>floppy</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>lun</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='bus'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>fdc</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>sata</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </disk>
Nov 27 03:13:47 user nova-compute[75006]:     <graphics supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>sdl</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vnc</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>spice</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>egl-headless</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </graphics>
Nov 27 03:13:47 user nova-compute[75006]:     <video supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='modelType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vga</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>cirrus</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vmvga</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>qxl</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>none</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>bochs</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>ramfb</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </video>
Nov 27 03:13:47 user nova-compute[75006]:     <hostdev supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='mode'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>subsystem</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='startupPolicy'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>default</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>mandatory</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>requisite</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>optional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='subsysType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>pci</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='capsType'/>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='pciBackend'/>
Nov 27 03:13:47 user nova-compute[75006]:     </hostdev>
Nov 27 03:13:47 user nova-compute[75006]:     <rng supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>random</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>egd</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>builtin</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </rng>
Nov 27 03:13:47 user nova-compute[75006]:     <filesystem supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='driverType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>path</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>handle</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtiofs</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </filesystem>
Nov 27 03:13:47 user nova-compute[75006]:     <tpm supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>tpm-tis</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>tpm-crb</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>passthrough</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>emulator</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </tpm>
Nov 27 03:13:47 user nova-compute[75006]:   </devices>
Nov 27 03:13:47 user nova-compute[75006]:   <features>
Nov 27 03:13:47 user nova-compute[75006]:     <gic supported='no'/>
Nov 27 03:13:47 user nova-compute[75006]:     <vmcoreinfo supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <genid supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <backingStoreInput supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <backup supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <sev supported='no'/>
Nov 27 03:13:47 user nova-compute[75006]:   </features>
Nov 27 03:13:47 user nova-compute[75006]: </domainCapabilities>
Nov 27 03:13:47 user nova-compute[75006]:  {{(pid=75006) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 27 03:13:47 user nova-compute[75006]: <domainCapabilities>
Nov 27 03:13:47 user nova-compute[75006]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 03:13:47 user nova-compute[75006]:   <domain>kvm</domain>
Nov 27 03:13:47 user nova-compute[75006]:   <machine>pc-i440fx-6.2</machine>
Nov 27 03:13:47 user nova-compute[75006]:   <arch>x86_64</arch>
Nov 27 03:13:47 user nova-compute[75006]:   <vcpu max='255'/>
Nov 27 03:13:47 user nova-compute[75006]:   <iothreads supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:   <os supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:     <enum name='firmware'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>efi</value>
Nov 27 03:13:47 user nova-compute[75006]:     </enum>
Nov 27 03:13:47 user nova-compute[75006]:     <loader supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>rom</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>pflash</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='readonly'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>yes</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='secure'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>no</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </loader>
Nov 27 03:13:47 user nova-compute[75006]:   </os>
Nov 27 03:13:47 user nova-compute[75006]:   <cpu>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='host-passthrough' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='hostPassthroughMigratable'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='maximum' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='maximumMigratable'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>on</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>off</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='host-model' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <vendor>Intel</vendor>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ss'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='vmx'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='pcid'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='hypervisor'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='arat'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='umip'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='md-clear'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='stibp'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ssbd'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='invtsc'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ibpb'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='ibrs'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='amd-stibp'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='rsba'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='disable' name='erms'/>
Nov 27 03:13:47 user nova-compute[75006]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:     <mode name='custom' supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>qemu64</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>qemu32</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>phenom</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium3</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium2</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>pentium</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>n270</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>kvm64</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>kvm32</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>coreduo</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>core2duo</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>athlon</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Westmere</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Snowridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Skylake-Client</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>SandyBridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Penryn</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G5</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G4</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G3</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Opteron_G2</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Opteron_G1</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Nehalem</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>IvyBridge</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Icelake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Haswell</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-Rome</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-Milan</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>EPYC</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Dhyana</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cooperlake</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>Conroe</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='no'>Broadwell</model>
Nov 27 03:13:47 user nova-compute[75006]:       <model usable='yes'>486</model>
Nov 27 03:13:47 user nova-compute[75006]:     </mode>
Nov 27 03:13:47 user nova-compute[75006]:   </cpu>
Nov 27 03:13:47 user nova-compute[75006]:   <memoryBacking supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:     <enum name='sourceType'>
Nov 27 03:13:47 user nova-compute[75006]:       <value>file</value>
Nov 27 03:13:47 user nova-compute[75006]:       <value>anonymous</value>
Nov 27 03:13:47 user nova-compute[75006]:       <value>memfd</value>
Nov 27 03:13:47 user nova-compute[75006]:     </enum>
Nov 27 03:13:47 user nova-compute[75006]:   </memoryBacking>
Nov 27 03:13:47 user nova-compute[75006]:   <devices>
Nov 27 03:13:47 user nova-compute[75006]:     <disk supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='diskDevice'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>disk</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>cdrom</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>floppy</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>lun</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='bus'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>ide</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>fdc</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>sata</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </disk>
Nov 27 03:13:47 user nova-compute[75006]:     <graphics supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='type'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>sdl</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vnc</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>spice</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>egl-headless</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </graphics>
Nov 27 03:13:47 user nova-compute[75006]:     <video supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='modelType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vga</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>cirrus</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>vmvga</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>qxl</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>none</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>bochs</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>ramfb</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </video>
Nov 27 03:13:47 user nova-compute[75006]:     <hostdev supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='mode'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>subsystem</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='startupPolicy'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>default</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>mandatory</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>requisite</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>optional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='subsysType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>usb</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>pci</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>scsi</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='capsType'/>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='pciBackend'/>
Nov 27 03:13:47 user nova-compute[75006]:     </hostdev>
Nov 27 03:13:47 user nova-compute[75006]:     <rng supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtio-non-transitional</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>random</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>egd</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>builtin</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </rng>
Nov 27 03:13:47 user nova-compute[75006]:     <filesystem supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='driverType'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>path</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>handle</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>virtiofs</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </filesystem>
Nov 27 03:13:47 user nova-compute[75006]:     <tpm supported='yes'>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='model'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>tpm-tis</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>tpm-crb</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:       <enum name='backendModel'>
Nov 27 03:13:47 user nova-compute[75006]:         <value>passthrough</value>
Nov 27 03:13:47 user nova-compute[75006]:         <value>emulator</value>
Nov 27 03:13:47 user nova-compute[75006]:       </enum>
Nov 27 03:13:47 user nova-compute[75006]:     </tpm>
Nov 27 03:13:47 user nova-compute[75006]:   </devices>
Nov 27 03:13:47 user nova-compute[75006]:   <features>
Nov 27 03:13:47 user nova-compute[75006]:     <gic supported='no'/>
Nov 27 03:13:47 user nova-compute[75006]:     <vmcoreinfo supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <genid supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <backingStoreInput supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <backup supported='yes'/>
Nov 27 03:13:47 user nova-compute[75006]:     <sev supported='no'/>
Nov 27 03:13:47 user nova-compute[75006]:   </features>
Nov 27 03:13:47 user nova-compute[75006]: </domainCapabilities>
Nov 27 03:13:47 user nova-compute[75006]:  {{(pid=75006) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75006) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75006) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75006) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 27 03:13:47 user nova-compute[75006]: INFO nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Secure Boot support detected
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] cpu compare xml: <cpu match="exact">
Nov 27 03:13:47 user nova-compute[75006]:   <model>Nehalem</model>
Nov 27 03:13:47 user nova-compute[75006]: </cpu>
Nov 27 03:13:47 user nova-compute[75006]:  {{(pid=75006) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 27 03:13:47 user nova-compute[75006]: INFO nova.virt.node [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Generated node identity b7ca9733-4bfc-461c-abb4-2c38c7e215cd
Nov 27 03:13:47 user nova-compute[75006]: INFO nova.virt.node [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Wrote node identity b7ca9733-4bfc-461c-abb4-2c38c7e215cd to /opt/stack/data/nova/compute_id
Nov 27 03:13:47 user nova-compute[75006]: WARNING nova.compute.manager [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Compute nodes ['b7ca9733-4bfc-461c-abb4-2c38c7e215cd'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 27 03:13:47 user nova-compute[75006]: INFO nova.compute.manager [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 27 03:13:47 user nova-compute[75006]: WARNING nova.compute.manager [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 27 03:13:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:13:47 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:13:47 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Hypervisor/Node resource view: name=user free_ram=10972MB free_disk=26.24500274658203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:13:47 user nova-compute[75006]: WARNING nova.compute.resource_tracker [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] No compute node record for user:b7ca9733-4bfc-461c-abb4-2c38c7e215cd: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b7ca9733-4bfc-461c-abb4-2c38c7e215cd could not be found.
Nov 27 03:13:47 user nova-compute[75006]: INFO nova.compute.resource_tracker [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Compute node record created for user:user with uuid: b7ca9733-4bfc-461c-abb4-2c38c7e215cd
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:13:47 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] [req-da2172e2-5b00-401f-9ba6-53574eddf58e] Created resource provider record via placement API for resource provider with UUID b7ca9733-4bfc-461c-abb4-2c38c7e215cd and name user.
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75006) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 27 03:13:47 user nova-compute[75006]: INFO nova.virt.libvirt.host [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] kernel doesn't support AMD SEV
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Libvirt baseline CPU <cpu>
Nov 27 03:13:47 user nova-compute[75006]:   <arch>x86_64</arch>
Nov 27 03:13:47 user nova-compute[75006]:   <model>Nehalem</model>
Nov 27 03:13:47 user nova-compute[75006]:   <vendor>Intel</vendor>
Nov 27 03:13:47 user nova-compute[75006]:   <topology sockets="6" cores="1" threads="1"/>
Nov 27 03:13:47 user nova-compute[75006]: </cpu>
Nov 27 03:13:47 user nova-compute[75006]:  {{(pid=75006) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Updated inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Updating resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd generation from 0 to 1 during operation: update_inventory {{(pid=75006) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 27 03:13:47 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:13:48 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Updating resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd generation from 1 to 2 during operation: update_traits {{(pid=75006) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 27 03:13:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:13:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:13:48 user nova-compute[75006]: DEBUG nova.service [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Creating RPC server for service compute {{(pid=75006) start /opt/stack/nova/nova/service.py:182}}
Nov 27 03:13:48 user nova-compute[75006]: DEBUG nova.service [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] Join ServiceGroup membership for this service compute {{(pid=75006) start /opt/stack/nova/nova/service.py:199}}
Nov 27 03:13:48 user nova-compute[75006]: DEBUG nova.servicegroup.drivers.db [None req-cf87c170-7d83-4647-9985-852fb7b718e3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75006) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 27 03:14:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:14:38 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:14:39 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:14:39 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:14:39 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=10369MB free_disk=26.148712158203125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:14:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:14:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:14:39 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:14:39 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:14:39 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:14:39 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:14:39 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:14:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:15:39 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:15:40 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:15:40 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:15:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=10306MB free_disk=26.213035583496094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:15:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:15:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:15:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:15:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:15:40 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:15:40 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:15:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:15:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:15:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:16:39 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:16:40 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:16:40 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:16:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=10307MB free_disk=25.96550750732422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:16:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:16:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:16:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:16:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:16:40 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:16:40 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:16:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:16:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:16:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:16:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:17:41 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:17:41 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:17:41 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9612MB free_disk=25.986194610595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:17:42 user nova-compute[75006]: INFO nova.compute.claims [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Claim successful on node user
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:17:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:17:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Creating image(s)
Nov 27 03:17:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "/opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "/opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "/opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG nova.policy [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99f4a1727f914876a12da8d0e18a31a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '312b6ab93c494b1e83935e050f83e67c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG nova.virt.images [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] e19384e9-bd8b-46ce-9cf0-3cac8b3d8868 was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe.part /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe.part /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe.converted" returned: 0 in 0.327s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.429s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:44 user nova-compute[75006]: INFO oslo.privsep.daemon [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxgkgw1ec/privsep.sock']
Nov 27 03:17:44 user sudo[84244]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxgkgw1ec/privsep.sock
Nov 27 03:17:44 user sudo[84244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 03:17:45 user sudo[84244]: pam_unix(sudo:session): session closed for user root
Nov 27 03:17:45 user nova-compute[75006]: INFO oslo.privsep.daemon [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Spawned new privsep daemon via rootwrap
Nov 27 03:17:45 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 03:17:45 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 03:17:45 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 27 03:17:45 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84248
Nov 27 03:17:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.213s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Successfully created port: d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.228s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk 1073741824" returned: 0 in 0.068s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Cannot resize image /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Ensure instance console log exists: /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:48 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Successfully updated port: d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:17:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:17:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquired lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:17:48 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:17:49 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:17:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-d31abad1-4b46-49e8-ab91-595745b2d5b4 req-4700a026-302b-4662-ac61-49194ce7a029 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received event network-changed-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:17:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-d31abad1-4b46-49e8-ab91-595745b2d5b4 req-4700a026-302b-4662-ac61-49194ce7a029 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Refreshing instance network info cache due to event network-changed-d1261e79-5578-40a6-a6d5-c84b660d05c7. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:17:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d31abad1-4b46-49e8-ab91-595745b2d5b4 req-4700a026-302b-4662-ac61-49194ce7a029 service nova] Acquiring lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Updating instance_info_cache with network_info: [{"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Releasing lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Instance network_info: |[{"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d31abad1-4b46-49e8-ab91-595745b2d5b4 req-4700a026-302b-4662-ac61-49194ce7a029 service nova] Acquired lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-d31abad1-4b46-49e8-ab91-595745b2d5b4 req-4700a026-302b-4662-ac61-49194ce7a029 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Refreshing network info cache for port d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Start _get_guest_xml network_info=[{"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:17:50 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:17:50 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1691578211',display_name='tempest-DeleteServersTestJSON-server-1691578211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1691578211',id=1,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312b6ab93c494b1e83935e050f83e67c',ramdisk_id='',reservation_id='r-ww00enfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1466743727',owner_user_name='tempest-DeleteServersTestJSON-1466743727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:43Z,user_data=None,user_id='99f4a1727f914876a12da8d0e18a31a8',uuid=cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Converting VIF {"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:37,bridge_name='br-int',has_traffic_filtering=True,id=d1261e79-5578-40a6-a6d5-c84b660d05c7,network=Network(a36dda8a-3441-44aa-8cf5-00eeb0d35c31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1261e79-55') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lazy-loading 'pci_devices' on Instance uuid cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:17:50 user nova-compute[75006]:   <uuid>cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c</uuid>
Nov 27 03:17:50 user nova-compute[75006]:   <name>instance-00000001</name>
Nov 27 03:17:50 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:17:50 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:17:50 user nova-compute[75006]:   <metadata>
Nov 27 03:17:50 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:17:50 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:17:50 user nova-compute[75006]:       <nova:name>tempest-DeleteServersTestJSON-server-1691578211</nova:name>
Nov 27 03:17:50 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:17:50</nova:creationTime>
Nov 27 03:17:50 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:17:50 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:17:50 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:17:50 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:17:50 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:17:50 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:17:50 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:17:50 user nova-compute[75006]:       <nova:owner>
Nov 27 03:17:50 user nova-compute[75006]:         <nova:user uuid="99f4a1727f914876a12da8d0e18a31a8">tempest-DeleteServersTestJSON-1466743727-project-member</nova:user>
Nov 27 03:17:50 user nova-compute[75006]:         <nova:project uuid="312b6ab93c494b1e83935e050f83e67c">tempest-DeleteServersTestJSON-1466743727</nova:project>
Nov 27 03:17:50 user nova-compute[75006]:       </nova:owner>
Nov 27 03:17:50 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:17:50 user nova-compute[75006]:       <nova:ports>
Nov 27 03:17:50 user nova-compute[75006]:         <nova:port uuid="d1261e79-5578-40a6-a6d5-c84b660d05c7">
Nov 27 03:17:50 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 03:17:50 user nova-compute[75006]:         </nova:port>
Nov 27 03:17:50 user nova-compute[75006]:       </nova:ports>
Nov 27 03:17:50 user nova-compute[75006]:     </nova:instance>
Nov 27 03:17:50 user nova-compute[75006]:   </metadata>
Nov 27 03:17:50 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:17:50 user nova-compute[75006]:     <system>
Nov 27 03:17:50 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:17:50 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:17:50 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:17:50 user nova-compute[75006]:       <entry name="serial">cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c</entry>
Nov 27 03:17:50 user nova-compute[75006]:       <entry name="uuid">cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c</entry>
Nov 27 03:17:50 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:17:50 user nova-compute[75006]:     </system>
Nov 27 03:17:50 user nova-compute[75006]:   </sysinfo>
Nov 27 03:17:50 user nova-compute[75006]:   <os>
Nov 27 03:17:50 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:17:50 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:17:50 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:17:50 user nova-compute[75006]:   </os>
Nov 27 03:17:50 user nova-compute[75006]:   <features>
Nov 27 03:17:50 user nova-compute[75006]:     <acpi/>
Nov 27 03:17:50 user nova-compute[75006]:     <apic/>
Nov 27 03:17:50 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:17:50 user nova-compute[75006]:   </features>
Nov 27 03:17:50 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:17:50 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:17:50 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:17:50 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:17:50 user nova-compute[75006]:   </clock>
Nov 27 03:17:50 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:17:50 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:17:50 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:17:50 user nova-compute[75006]:   </cpu>
Nov 27 03:17:50 user nova-compute[75006]:   <devices>
Nov 27 03:17:50 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:17:50 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:17:50 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk"/>
Nov 27 03:17:50 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:17:50 user nova-compute[75006]:     </disk>
Nov 27 03:17:50 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:17:50 user nova-compute[75006]:       <mac address="fa:16:3e:b1:9e:37"/>
Nov 27 03:17:50 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:17:50 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:17:50 user nova-compute[75006]:       <target dev="tapd1261e79-55"/>
Nov 27 03:17:50 user nova-compute[75006]:     </interface>
Nov 27 03:17:50 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:17:50 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/console.log" append="off"/>
Nov 27 03:17:50 user nova-compute[75006]:     </serial>
Nov 27 03:17:50 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:17:50 user nova-compute[75006]:     <video>
Nov 27 03:17:50 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:17:50 user nova-compute[75006]:     </video>
Nov 27 03:17:50 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:17:50 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:17:50 user nova-compute[75006]:     </rng>
Nov 27 03:17:50 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:17:50 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:17:50 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:17:50 user nova-compute[75006]:     </memballoon>
Nov 27 03:17:50 user nova-compute[75006]:   </devices>
Nov 27 03:17:50 user nova-compute[75006]: </domain>
Nov 27 03:17:50 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1691578211',display_name='tempest-DeleteServersTestJSON-server-1691578211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1691578211',id=1,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='312b6ab93c494b1e83935e050f83e67c',ramdisk_id='',reservation_id='r-ww00enfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1466743727',owner_user_name='tempest-DeleteServersTestJSON-1466743727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:43Z,user_data=None,user_id='99f4a1727f914876a12da8d0e18a31a8',uuid=cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Converting VIF {"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:37,bridge_name='br-int',has_traffic_filtering=True,id=d1261e79-5578-40a6-a6d5-c84b660d05c7,network=Network(a36dda8a-3441-44aa-8cf5-00eeb0d35c31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1261e79-55') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG os_vif [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:37,bridge_name='br-int',has_traffic_filtering=True,id=d1261e79-5578-40a6-a6d5-c84b660d05c7,network=Network(a36dda8a-3441-44aa-8cf5-00eeb0d35c31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1261e79-55') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Created schema index Interface.name {{(pid=75006) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Created schema index Port.name {{(pid=75006) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Created schema index Bridge.name {{(pid=75006) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [POLLOUT] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e87641dd-347d-51b7-8b33-f144066b000f', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:17:50 user nova-compute[75006]: INFO oslo.privsep.daemon [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpp03wnvl1/privsep.sock']
Nov 27 03:17:50 user sudo[84278]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpp03wnvl1/privsep.sock
Nov 27 03:17:50 user sudo[84278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 03:17:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "fd992ae2-0b97-47d2-9e03-f707af65f190" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:17:51 user nova-compute[75006]: INFO nova.compute.claims [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Claim successful on node user
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:17:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.policy [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5489e0f1a5c4bb1896c89ffaed79d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca85c0868b6468fb2a3025ccd562f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:17:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Creating image(s)
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "/opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "/opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk 1073741824" returned: 0 in 0.041s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:52 user sudo[84278]: pam_unix(sudo:session): session closed for user root
Nov 27 03:17:52 user nova-compute[75006]: INFO oslo.privsep.daemon [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Spawned new privsep daemon via rootwrap
Nov 27 03:17:52 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 03:17:52 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 03:17:52 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 27 03:17:52 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84288
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-d31abad1-4b46-49e8-ab91-595745b2d5b4 req-4700a026-302b-4662-ac61-49194ce7a029 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Updated VIF entry in instance network info cache for port d1261e79-5578-40a6-a6d5-c84b660d05c7. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-d31abad1-4b46-49e8-ab91-595745b2d5b4 req-4700a026-302b-4662-ac61-49194ce7a029 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Updating instance_info_cache with network_info: [{"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d31abad1-4b46-49e8-ab91-595745b2d5b4 req-4700a026-302b-4662-ac61-49194ce7a029 service nova] Releasing lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Cannot resize image /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Ensure instance console log exists: /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1261e79-55, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1261e79-55, col_values=(('qos', UUID('ca02e156-4621-465c-8c56-942f4419c298')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1261e79-55, col_values=(('external_ids', {'iface-id': 'd1261e79-5578-40a6-a6d5-c84b660d05c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:9e:37', 'vm-uuid': 'cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:52 user nova-compute[75006]: INFO os_vif [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:37,bridge_name='br-int',has_traffic_filtering=True,id=d1261e79-5578-40a6-a6d5-c84b660d05c7,network=Network(a36dda8a-3441-44aa-8cf5-00eeb0d35c31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1261e79-55')
Nov 27 03:17:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:17:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] No VIF found with MAC fa:16:3e:b1:9e:37, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:17:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Successfully created port: ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:17:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Successfully updated port: ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:17:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:17:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquired lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:17:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:17:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:17:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Instance spawned successfully.
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-114a57f3-9de7-4f93-baca-15524dac3b3c req-d99e7591-f9c5-457c-b6e8-b2e614bfd71b service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received event network-changed-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-114a57f3-9de7-4f93-baca-15524dac3b3c req-d99e7591-f9c5-457c-b6e8-b2e614bfd71b service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Refreshing instance network info cache due to event network-changed-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-114a57f3-9de7-4f93-baca-15524dac3b3c req-d99e7591-f9c5-457c-b6e8-b2e614bfd71b service nova] Acquiring lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:17:56 user nova-compute[75006]: INFO nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Took 13.55 seconds to spawn the instance on the hypervisor.
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:17:56 user nova-compute[75006]: INFO nova.compute.manager [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Took 14.63 seconds to build instance.
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0eb50578-d270-4748-bb22-161b5482a919 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.855s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:17:56 user nova-compute[75006]: INFO nova.compute.claims [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Claim successful on node user
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Updating instance_info_cache with network_info: [{"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Releasing lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Instance network_info: |[{"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-114a57f3-9de7-4f93-baca-15524dac3b3c req-d99e7591-f9c5-457c-b6e8-b2e614bfd71b service nova] Acquired lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.network.neutron [req-114a57f3-9de7-4f93-baca-15524dac3b3c req-d99e7591-f9c5-457c-b6e8-b2e614bfd71b service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Refreshing network info cache for port ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Start _get_guest_xml network_info=[{"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:17:56 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:17:56 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1303896564',display_name='tempest-ServersNegativeTestJSON-server-1303896564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1303896564',id=2,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ca85c0868b6468fb2a3025ccd562f91',ramdisk_id='',reservation_id='r-blaov2vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-809508397',owner_user_name='tempest-ServersNegativeTestJSON-809508397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:52Z,user_data=None,user_id='b5489e0f1a5c4bb1896c89ffaed79d77',uuid=fd992ae2-0b97-47d2-9e03-f707af65f190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converting VIF {"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:13:d4,bridge_name='br-int',has_traffic_filtering=True,id=ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac73c62b-63') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lazy-loading 'pci_devices' on Instance uuid fd992ae2-0b97-47d2-9e03-f707af65f190 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:17:56 user nova-compute[75006]:   <uuid>fd992ae2-0b97-47d2-9e03-f707af65f190</uuid>
Nov 27 03:17:56 user nova-compute[75006]:   <name>instance-00000002</name>
Nov 27 03:17:56 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:17:56 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:17:56 user nova-compute[75006]:   <metadata>
Nov 27 03:17:56 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:17:56 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:17:56 user nova-compute[75006]:       <nova:name>tempest-ServersNegativeTestJSON-server-1303896564</nova:name>
Nov 27 03:17:56 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:17:56</nova:creationTime>
Nov 27 03:17:56 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:17:56 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:17:56 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:17:56 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:17:56 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:17:56 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:17:56 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:17:56 user nova-compute[75006]:       <nova:owner>
Nov 27 03:17:56 user nova-compute[75006]:         <nova:user uuid="b5489e0f1a5c4bb1896c89ffaed79d77">tempest-ServersNegativeTestJSON-809508397-project-member</nova:user>
Nov 27 03:17:56 user nova-compute[75006]:         <nova:project uuid="9ca85c0868b6468fb2a3025ccd562f91">tempest-ServersNegativeTestJSON-809508397</nova:project>
Nov 27 03:17:56 user nova-compute[75006]:       </nova:owner>
Nov 27 03:17:56 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:17:56 user nova-compute[75006]:       <nova:ports>
Nov 27 03:17:56 user nova-compute[75006]:         <nova:port uuid="ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b">
Nov 27 03:17:56 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 03:17:56 user nova-compute[75006]:         </nova:port>
Nov 27 03:17:56 user nova-compute[75006]:       </nova:ports>
Nov 27 03:17:56 user nova-compute[75006]:     </nova:instance>
Nov 27 03:17:56 user nova-compute[75006]:   </metadata>
Nov 27 03:17:56 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:17:56 user nova-compute[75006]:     <system>
Nov 27 03:17:56 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:17:56 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:17:56 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:17:56 user nova-compute[75006]:       <entry name="serial">fd992ae2-0b97-47d2-9e03-f707af65f190</entry>
Nov 27 03:17:56 user nova-compute[75006]:       <entry name="uuid">fd992ae2-0b97-47d2-9e03-f707af65f190</entry>
Nov 27 03:17:56 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:17:56 user nova-compute[75006]:     </system>
Nov 27 03:17:56 user nova-compute[75006]:   </sysinfo>
Nov 27 03:17:56 user nova-compute[75006]:   <os>
Nov 27 03:17:56 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:17:56 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:17:56 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:17:56 user nova-compute[75006]:   </os>
Nov 27 03:17:56 user nova-compute[75006]:   <features>
Nov 27 03:17:56 user nova-compute[75006]:     <acpi/>
Nov 27 03:17:56 user nova-compute[75006]:     <apic/>
Nov 27 03:17:56 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:17:56 user nova-compute[75006]:   </features>
Nov 27 03:17:56 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:17:56 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:17:56 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:17:56 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:17:56 user nova-compute[75006]:   </clock>
Nov 27 03:17:56 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:17:56 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:17:56 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:17:56 user nova-compute[75006]:   </cpu>
Nov 27 03:17:56 user nova-compute[75006]:   <devices>
Nov 27 03:17:56 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:17:56 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:17:56 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk"/>
Nov 27 03:17:56 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:17:56 user nova-compute[75006]:     </disk>
Nov 27 03:17:56 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:17:56 user nova-compute[75006]:       <mac address="fa:16:3e:08:13:d4"/>
Nov 27 03:17:56 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:17:56 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:17:56 user nova-compute[75006]:       <target dev="tapac73c62b-63"/>
Nov 27 03:17:56 user nova-compute[75006]:     </interface>
Nov 27 03:17:56 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:17:56 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/console.log" append="off"/>
Nov 27 03:17:56 user nova-compute[75006]:     </serial>
Nov 27 03:17:56 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:17:56 user nova-compute[75006]:     <video>
Nov 27 03:17:56 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:17:56 user nova-compute[75006]:     </video>
Nov 27 03:17:56 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:17:56 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:17:56 user nova-compute[75006]:     </rng>
Nov 27 03:17:56 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:17:56 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:17:56 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:17:56 user nova-compute[75006]:     </memballoon>
Nov 27 03:17:56 user nova-compute[75006]:   </devices>
Nov 27 03:17:56 user nova-compute[75006]: </domain>
Nov 27 03:17:56 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1303896564',display_name='tempest-ServersNegativeTestJSON-server-1303896564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1303896564',id=2,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ca85c0868b6468fb2a3025ccd562f91',ramdisk_id='',reservation_id='r-blaov2vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-809508397',owner_user_name='tempest-ServersNegativeTestJSON-809508397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:52Z,user_data=None,user_id='b5489e0f1a5c4bb1896c89ffaed79d77',uuid=fd992ae2-0b97-47d2-9e03-f707af65f190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converting VIF {"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:13:d4,bridge_name='br-int',has_traffic_filtering=True,id=ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac73c62b-63') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG os_vif [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:13:d4,bridge_name='br-int',has_traffic_filtering=True,id=ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac73c62b-63') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '041e903a-5f75-5a74-a871-2d058076697f', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac73c62b-63, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac73c62b-63, col_values=(('qos', UUID('5b812794-c87f-4452-b809-5b810d7c0e3f')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac73c62b-63, col_values=(('external_ids', {'iface-id': 'ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:13:d4', 'vm-uuid': 'fd992ae2-0b97-47d2-9e03-f707af65f190'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:56 user nova-compute[75006]: INFO os_vif [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:13:d4,bridge_name='br-int',has_traffic_filtering=True,id=ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac73c62b-63')
Nov 27 03:17:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] No VIF found with MAC fa:16:3e:08:13:d4, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:57 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.009s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:17:57 user nova-compute[75006]: INFO nova.compute.claims [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Claim successful on node user
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:17:57 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Creating image(s)
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.policy [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1275432e762e409d92b00e7c3303de53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c41971e35b24517acd8b84a22e14b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk 1073741824" returned: 0 in 0.066s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-114a57f3-9de7-4f93-baca-15524dac3b3c req-d99e7591-f9c5-457c-b6e8-b2e614bfd71b service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Updated VIF entry in instance network info cache for port ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:17:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-114a57f3-9de7-4f93-baca-15524dac3b3c req-d99e7591-f9c5-457c-b6e8-b2e614bfd71b service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Updating instance_info_cache with network_info: [{"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-114a57f3-9de7-4f93-baca-15524dac3b3c req-d99e7591-f9c5-457c-b6e8-b2e614bfd71b service nova] Releasing lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.118s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.242s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:17:58 user nova-compute[75006]: INFO nova.compute.claims [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Claim successful on node user
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:17:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Cannot resize image /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Ensure instance console log exists: /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.policy [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1836d0da810f4525addd0b02ae57c617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30af4989ad4414083de0576cf4dbd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:17:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Creating image(s)
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "/opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "/opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.292s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:17:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk 1073741824" returned: 0 in 0.058s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:17:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Creating image(s)
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.194s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.policy [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '204e517cbd36494c94ee36e63da3acb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfddf9022e8d4376ac00c17e04118132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Cannot resize image /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Ensure instance console log exists: /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk 1073741824" returned: 0 in 0.052s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Successfully created port: 1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Cannot resize image /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Ensure instance console log exists: /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:17:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Successfully created port: fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Instance spawned successfully.
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:01 user nova-compute[75006]: INFO nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Took 9.34 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:01 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:01 user nova-compute[75006]: INFO nova.compute.manager [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Took 10.25 seconds to build instance.
Nov 27 03:18:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b101a197-0464-4ff3-92d3-4b90760ac8d0 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.410s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Successfully created port: f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Successfully updated port: 1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquired lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-e4a8e9aa-82a1-4e98-8c11-90d353307dc6 req-9d8c1b25-e0df-41e0-bc61-5d599ad7c564 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-changed-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-e4a8e9aa-82a1-4e98-8c11-90d353307dc6 req-9d8c1b25-e0df-41e0-bc61-5d599ad7c564 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Refreshing instance network info cache due to event network-changed-1f7e81ab-1878-407b-a8fe-02ea2918ff76. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4a8e9aa-82a1-4e98-8c11-90d353307dc6 req-9d8c1b25-e0df-41e0-bc61-5d599ad7c564 service nova] Acquiring lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Successfully updated port: fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquired lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-db759c44-5db9-4f9f-9fee-cf4b97c3ac54 req-9e2bd9d3-41ac-40d8-8d3f-694c4bd6ca39 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received event network-changed-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-db759c44-5db9-4f9f-9fee-cf4b97c3ac54 req-9e2bd9d3-41ac-40d8-8d3f-694c4bd6ca39 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Refreshing instance network info cache due to event network-changed-fe877835-a1ab-434a-8eff-de1db84f2425. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db759c44-5db9-4f9f-9fee-cf4b97c3ac54 req-9e2bd9d3-41ac-40d8-8d3f-694c4bd6ca39 service nova] Acquiring lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Successfully updated port: f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquired lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Releasing lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance network_info: |[{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4a8e9aa-82a1-4e98-8c11-90d353307dc6 req-9d8c1b25-e0df-41e0-bc61-5d599ad7c564 service nova] Acquired lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-e4a8e9aa-82a1-4e98-8c11-90d353307dc6 req-9d8c1b25-e0df-41e0-bc61-5d599ad7c564 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Refreshing network info cache for port 1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Start _get_guest_xml network_info=[{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'pci_devices' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:03 user nova-compute[75006]:   <uuid>70a4bf10-12f0-4b99-baa2-53be7becbb21</uuid>
Nov 27 03:18:03 user nova-compute[75006]:   <name>instance-00000003</name>
Nov 27 03:18:03 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:03 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:03 user nova-compute[75006]:   <metadata>
Nov 27 03:18:03 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:03 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:03 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeTestJSON-server-1573842622</nova:name>
Nov 27 03:18:03 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:03</nova:creationTime>
Nov 27 03:18:03 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:03 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:03 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:03 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:03 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:03 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:03 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:03 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:03 user nova-compute[75006]:         <nova:user uuid="1275432e762e409d92b00e7c3303de53">tempest-AttachVolumeTestJSON-245260319-project-member</nova:user>
Nov 27 03:18:03 user nova-compute[75006]:         <nova:project uuid="9c41971e35b24517acd8b84a22e14b97">tempest-AttachVolumeTestJSON-245260319</nova:project>
Nov 27 03:18:03 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:03 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:18:03 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:03 user nova-compute[75006]:         <nova:port uuid="1f7e81ab-1878-407b-a8fe-02ea2918ff76">
Nov 27 03:18:03 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 03:18:03 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:03 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:03 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:03 user nova-compute[75006]:   </metadata>
Nov 27 03:18:03 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:03 user nova-compute[75006]:     <system>
Nov 27 03:18:03 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:03 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:03 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:03 user nova-compute[75006]:       <entry name="serial">70a4bf10-12f0-4b99-baa2-53be7becbb21</entry>
Nov 27 03:18:03 user nova-compute[75006]:       <entry name="uuid">70a4bf10-12f0-4b99-baa2-53be7becbb21</entry>
Nov 27 03:18:03 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:03 user nova-compute[75006]:     </system>
Nov 27 03:18:03 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:03 user nova-compute[75006]:   <os>
Nov 27 03:18:03 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:03 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:03 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:03 user nova-compute[75006]:   </os>
Nov 27 03:18:03 user nova-compute[75006]:   <features>
Nov 27 03:18:03 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:03 user nova-compute[75006]:     <apic/>
Nov 27 03:18:03 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:03 user nova-compute[75006]:   </features>
Nov 27 03:18:03 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:03 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:03 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:03 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:03 user nova-compute[75006]:   </clock>
Nov 27 03:18:03 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:03 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:03 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:03 user nova-compute[75006]:   </cpu>
Nov 27 03:18:03 user nova-compute[75006]:   <devices>
Nov 27 03:18:03 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:18:03 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:18:03 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk"/>
Nov 27 03:18:03 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:18:03 user nova-compute[75006]:     </disk>
Nov 27 03:18:03 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:03 user nova-compute[75006]:       <mac address="fa:16:3e:1a:de:2b"/>
Nov 27 03:18:03 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:03 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:03 user nova-compute[75006]:       <target dev="tap1f7e81ab-18"/>
Nov 27 03:18:03 user nova-compute[75006]:     </interface>
Nov 27 03:18:03 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:03 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/console.log" append="off"/>
Nov 27 03:18:03 user nova-compute[75006]:     </serial>
Nov 27 03:18:03 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:03 user nova-compute[75006]:     <video>
Nov 27 03:18:03 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:03 user nova-compute[75006]:     </video>
Nov 27 03:18:03 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:03 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:03 user nova-compute[75006]:     </rng>
Nov 27 03:18:03 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:03 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:03 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:03 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:03 user nova-compute[75006]:   </devices>
Nov 27 03:18:03 user nova-compute[75006]: </domain>
Nov 27 03:18:03 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG os_vif [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f256d33d-da2b-5e53-ab9a-c99eba3c2511', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f7e81ab-18, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f7e81ab-18, col_values=(('qos', UUID('9d00af53-a923-45c4-8013-6056a5588bdc')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f7e81ab-18, col_values=(('external_ids', {'iface-id': '1f7e81ab-1878-407b-a8fe-02ea2918ff76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:de:2b', 'vm-uuid': '70a4bf10-12f0-4b99-baa2-53be7becbb21'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:03 user nova-compute[75006]: INFO os_vif [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18')
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No VIF found with MAC fa:16:3e:1a:de:2b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-a4467ce1-b6df-4c38-87cb-bad24fbdc8f6 req-baf4f0eb-fef3-4719-a73b-dbb8e13ec875 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-changed-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-a4467ce1-b6df-4c38-87cb-bad24fbdc8f6 req-baf4f0eb-fef3-4719-a73b-dbb8e13ec875 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Refreshing instance network info cache due to event network-changed-f94812d5-e03a-40d6-88c1-6fe71880aa1d. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a4467ce1-b6df-4c38-87cb-bad24fbdc8f6 req-baf4f0eb-fef3-4719-a73b-dbb8e13ec875 service nova] Acquiring lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Releasing lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance network_info: |[{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a4467ce1-b6df-4c38-87cb-bad24fbdc8f6 req-baf4f0eb-fef3-4719-a73b-dbb8e13ec875 service nova] Acquired lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-a4467ce1-b6df-4c38-87cb-bad24fbdc8f6 req-baf4f0eb-fef3-4719-a73b-dbb8e13ec875 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Refreshing network info cache for port f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Start _get_guest_xml network_info=[{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-166334771',display_name='tempest-ServerStableDeviceRescueTest-server-166334771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-166334771',id=5,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkrvgso/+qYjDfRCrx5012kbek4Rd4RdwB6W/v4Ei54TxDnuJEm+BKPDOZU4Pzpb/hPvWhcT2lFjZjpaZ+X06ujo/JFr4LnGzCr1Fw0qFZv6B92syOK38/REaSqI9jAwg==',key_name='tempest-keypair-236960693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfddf9022e8d4376ac00c17e04118132',ramdisk_id='',reservation_id='r-pfp5lkz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-303496041',owner_user_name='tempest-ServerStableDeviceRescueTest-303496041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204e517cbd36494c94ee36e63da3acb6',uuid=fa069296-0bb8-4b82-bedf-d1a8d8cd104e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Converting VIF {"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:6e:07,bridge_name='br-int',has_traffic_filtering=True,id=f94812d5-e03a-40d6-88c1-6fe71880aa1d,network=Network(f054fb9a-ad51-4dc5-9d8e-531acafaad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94812d5-e0') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.objects.instance [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'pci_devices' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:04 user nova-compute[75006]:   <uuid>fa069296-0bb8-4b82-bedf-d1a8d8cd104e</uuid>
Nov 27 03:18:04 user nova-compute[75006]:   <name>instance-00000005</name>
Nov 27 03:18:04 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:04 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:04 user nova-compute[75006]:   <metadata>
Nov 27 03:18:04 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:04 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-166334771</nova:name>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:04</nova:creationTime>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:04 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:04 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:user uuid="204e517cbd36494c94ee36e63da3acb6">tempest-ServerStableDeviceRescueTest-303496041-project-member</nova:user>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:project uuid="bfddf9022e8d4376ac00c17e04118132">tempest-ServerStableDeviceRescueTest-303496041</nova:project>
Nov 27 03:18:04 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:port uuid="f94812d5-e03a-40d6-88c1-6fe71880aa1d">
Nov 27 03:18:04 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 03:18:04 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:04 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:04 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:04 user nova-compute[75006]:   </metadata>
Nov 27 03:18:04 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:04 user nova-compute[75006]:     <system>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="serial">fa069296-0bb8-4b82-bedf-d1a8d8cd104e</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="uuid">fa069296-0bb8-4b82-bedf-d1a8d8cd104e</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:04 user nova-compute[75006]:     </system>
Nov 27 03:18:04 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:04 user nova-compute[75006]:   <os>
Nov 27 03:18:04 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:04 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:04 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:04 user nova-compute[75006]:   </os>
Nov 27 03:18:04 user nova-compute[75006]:   <features>
Nov 27 03:18:04 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:04 user nova-compute[75006]:     <apic/>
Nov 27 03:18:04 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:04 user nova-compute[75006]:   </features>
Nov 27 03:18:04 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:04 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:04 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:04 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:04 user nova-compute[75006]:   </clock>
Nov 27 03:18:04 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:04 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:04 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:04 user nova-compute[75006]:   </cpu>
Nov 27 03:18:04 user nova-compute[75006]:   <devices>
Nov 27 03:18:04 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:18:04 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:18:04 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk"/>
Nov 27 03:18:04 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:18:04 user nova-compute[75006]:     </disk>
Nov 27 03:18:04 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:04 user nova-compute[75006]:       <mac address="fa:16:3e:8f:6e:07"/>
Nov 27 03:18:04 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:04 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:04 user nova-compute[75006]:       <target dev="tapf94812d5-e0"/>
Nov 27 03:18:04 user nova-compute[75006]:     </interface>
Nov 27 03:18:04 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:04 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/console.log" append="off"/>
Nov 27 03:18:04 user nova-compute[75006]:     </serial>
Nov 27 03:18:04 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:04 user nova-compute[75006]:     <video>
Nov 27 03:18:04 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:04 user nova-compute[75006]:     </video>
Nov 27 03:18:04 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:04 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:04 user nova-compute[75006]:     </rng>
Nov 27 03:18:04 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:04 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:04 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:04 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:04 user nova-compute[75006]:   </devices>
Nov 27 03:18:04 user nova-compute[75006]: </domain>
Nov 27 03:18:04 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-166334771',display_name='tempest-ServerStableDeviceRescueTest-server-166334771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-166334771',id=5,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkrvgso/+qYjDfRCrx5012kbek4Rd4RdwB6W/v4Ei54TxDnuJEm+BKPDOZU4Pzpb/hPvWhcT2lFjZjpaZ+X06ujo/JFr4LnGzCr1Fw0qFZv6B92syOK38/REaSqI9jAwg==',key_name='tempest-keypair-236960693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfddf9022e8d4376ac00c17e04118132',ramdisk_id='',reservation_id='r-pfp5lkz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-303496041',owner_user_name='tempest-ServerStableDeviceRescueTest-303496041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204e517cbd36494c94ee36e63da3acb6',uuid=fa069296-0bb8-4b82-bedf-d1a8d8cd104e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Converting VIF {"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:6e:07,bridge_name='br-int',has_traffic_filtering=True,id=f94812d5-e03a-40d6-88c1-6fe71880aa1d,network=Network(f054fb9a-ad51-4dc5-9d8e-531acafaad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94812d5-e0') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG os_vif [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:6e:07,bridge_name='br-int',has_traffic_filtering=True,id=f94812d5-e03a-40d6-88c1-6fe71880aa1d,network=Network(f054fb9a-ad51-4dc5-9d8e-531acafaad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94812d5-e0') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59603a28-c4f2-599e-9460-8e8dcb40f323', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf94812d5-e0, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf94812d5-e0, col_values=(('qos', UUID('4cd126ea-f90e-49bb-8d66-650c4dae6321')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf94812d5-e0, col_values=(('external_ids', {'iface-id': 'f94812d5-e03a-40d6-88c1-6fe71880aa1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:6e:07', 'vm-uuid': 'fa069296-0bb8-4b82-bedf-d1a8d8cd104e'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: INFO os_vif [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:6e:07,bridge_name='br-int',has_traffic_filtering=True,id=f94812d5-e03a-40d6-88c1-6fe71880aa1d,network=Network(f054fb9a-ad51-4dc5-9d8e-531acafaad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94812d5-e0')
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updating instance_info_cache with network_info: [{"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No VIF found with MAC fa:16:3e:8f:6e:07, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Releasing lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Instance network_info: |[{"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db759c44-5db9-4f9f-9fee-cf4b97c3ac54 req-9e2bd9d3-41ac-40d8-8d3f-694c4bd6ca39 service nova] Acquired lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-db759c44-5db9-4f9f-9fee-cf4b97c3ac54 req-9e2bd9d3-41ac-40d8-8d3f-694c4bd6ca39 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Refreshing network info cache for port fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Start _get_guest_xml network_info=[{"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2137649091',display_name='tempest-AttachVolumeNegativeTest-server-2137649091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2137649091',id=4,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXLzYXwviu59yTMlRhbT80OhEGYiBawXlZpIm/cVX7TnUJ/2eKns0D1T7aNNU6CH0+MT27NbRiIqIY+KmkATNnqNRbEmiuni+AsE1b5zTUCXj0SyxaMFIfaYDDZrG5gQ==',key_name='tempest-keypair-834301241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-h5g1ef6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=5ee0634e-e918-4e98-a42c-496e3f7de095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c7:bd,bridge_name='br-int',has_traffic_filtering=True,id=fe877835-a1ab-434a-8eff-de1db84f2425,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe877835-a1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ee0634e-e918-4e98-a42c-496e3f7de095 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:04 user nova-compute[75006]:   <uuid>5ee0634e-e918-4e98-a42c-496e3f7de095</uuid>
Nov 27 03:18:04 user nova-compute[75006]:   <name>instance-00000004</name>
Nov 27 03:18:04 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:04 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:04 user nova-compute[75006]:   <metadata>
Nov 27 03:18:04 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:04 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2137649091</nova:name>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:04</nova:creationTime>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:04 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:04 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:user uuid="1836d0da810f4525addd0b02ae57c617">tempest-AttachVolumeNegativeTest-66969864-project-member</nova:user>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:project uuid="f30af4989ad4414083de0576cf4dbd48">tempest-AttachVolumeNegativeTest-66969864</nova:project>
Nov 27 03:18:04 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:18:04 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:04 user nova-compute[75006]:         <nova:port uuid="fe877835-a1ab-434a-8eff-de1db84f2425">
Nov 27 03:18:04 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:18:04 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:04 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:04 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:04 user nova-compute[75006]:   </metadata>
Nov 27 03:18:04 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:04 user nova-compute[75006]:     <system>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="serial">5ee0634e-e918-4e98-a42c-496e3f7de095</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="uuid">5ee0634e-e918-4e98-a42c-496e3f7de095</entry>
Nov 27 03:18:04 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:04 user nova-compute[75006]:     </system>
Nov 27 03:18:04 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:04 user nova-compute[75006]:   <os>
Nov 27 03:18:04 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:04 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:04 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:04 user nova-compute[75006]:   </os>
Nov 27 03:18:04 user nova-compute[75006]:   <features>
Nov 27 03:18:04 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:04 user nova-compute[75006]:     <apic/>
Nov 27 03:18:04 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:04 user nova-compute[75006]:   </features>
Nov 27 03:18:04 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:04 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:04 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:04 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:04 user nova-compute[75006]:   </clock>
Nov 27 03:18:04 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:04 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:04 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:04 user nova-compute[75006]:   </cpu>
Nov 27 03:18:04 user nova-compute[75006]:   <devices>
Nov 27 03:18:04 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:18:04 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:18:04 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk"/>
Nov 27 03:18:04 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:18:04 user nova-compute[75006]:     </disk>
Nov 27 03:18:04 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:04 user nova-compute[75006]:       <mac address="fa:16:3e:1b:c7:bd"/>
Nov 27 03:18:04 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:04 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:04 user nova-compute[75006]:       <target dev="tapfe877835-a1"/>
Nov 27 03:18:04 user nova-compute[75006]:     </interface>
Nov 27 03:18:04 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:04 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/console.log" append="off"/>
Nov 27 03:18:04 user nova-compute[75006]:     </serial>
Nov 27 03:18:04 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:04 user nova-compute[75006]:     <video>
Nov 27 03:18:04 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:04 user nova-compute[75006]:     </video>
Nov 27 03:18:04 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:04 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:04 user nova-compute[75006]:     </rng>
Nov 27 03:18:04 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:04 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:04 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:04 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:04 user nova-compute[75006]:   </devices>
Nov 27 03:18:04 user nova-compute[75006]: </domain>
Nov 27 03:18:04 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2137649091',display_name='tempest-AttachVolumeNegativeTest-server-2137649091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2137649091',id=4,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXLzYXwviu59yTMlRhbT80OhEGYiBawXlZpIm/cVX7TnUJ/2eKns0D1T7aNNU6CH0+MT27NbRiIqIY+KmkATNnqNRbEmiuni+AsE1b5zTUCXj0SyxaMFIfaYDDZrG5gQ==',key_name='tempest-keypair-834301241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-h5g1ef6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=5ee0634e-e918-4e98-a42c-496e3f7de095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c7:bd,bridge_name='br-int',has_traffic_filtering=True,id=fe877835-a1ab-434a-8eff-de1db84f2425,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe877835-a1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG os_vif [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c7:bd,bridge_name='br-int',has_traffic_filtering=True,id=fe877835-a1ab-434a-8eff-de1db84f2425,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe877835-a1') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41580a80-b1eb-5035-8dc3-0141c09566cd', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe877835-a1, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe877835-a1, col_values=(('qos', UUID('a856ea06-7a21-4938-82b6-47befe1f0375')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe877835-a1, col_values=(('external_ids', {'iface-id': 'fe877835-a1ab-434a-8eff-de1db84f2425', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:c7:bd', 'vm-uuid': '5ee0634e-e918-4e98-a42c-496e3f7de095'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:04 user nova-compute[75006]: INFO os_vif [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c7:bd,bridge_name='br-int',has_traffic_filtering=True,id=fe877835-a1ab-434a-8eff-de1db84f2425,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe877835-a1')
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-e4a8e9aa-82a1-4e98-8c11-90d353307dc6 req-9d8c1b25-e0df-41e0-bc61-5d599ad7c564 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updated VIF entry in instance network info cache for port 1f7e81ab-1878-407b-a8fe-02ea2918ff76. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-e4a8e9aa-82a1-4e98-8c11-90d353307dc6 req-9d8c1b25-e0df-41e0-bc61-5d599ad7c564 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4a8e9aa-82a1-4e98-8c11-90d353307dc6 req-9d8c1b25-e0df-41e0-bc61-5d599ad7c564 service nova] Releasing lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No VIF found with MAC fa:16:3e:1b:c7:bd, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-a4467ce1-b6df-4c38-87cb-bad24fbdc8f6 req-baf4f0eb-fef3-4719-a73b-dbb8e13ec875 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updated VIF entry in instance network info cache for port f94812d5-e03a-40d6-88c1-6fe71880aa1d. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-a4467ce1-b6df-4c38-87cb-bad24fbdc8f6 req-baf4f0eb-fef3-4719-a73b-dbb8e13ec875 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a4467ce1-b6df-4c38-87cb-bad24fbdc8f6 req-baf4f0eb-fef3-4719-a73b-dbb8e13ec875 service nova] Releasing lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-db759c44-5db9-4f9f-9fee-cf4b97c3ac54 req-9e2bd9d3-41ac-40d8-8d3f-694c4bd6ca39 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updated VIF entry in instance network info cache for port fe877835-a1ab-434a-8eff-de1db84f2425. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-db759c44-5db9-4f9f-9fee-cf4b97c3ac54 req-9e2bd9d3-41ac-40d8-8d3f-694c4bd6ca39 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updating instance_info_cache with network_info: [{"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db759c44-5db9-4f9f-9fee-cf4b97c3ac54 req-9e2bd9d3-41ac-40d8-8d3f-694c4bd6ca39 service nova] Releasing lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-6c110ad2-7766-4de8-b6fb-7af0d7b2a311 req-bc6eca34-4000-4489-86c4-7638b008a54d service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received event network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6c110ad2-7766-4de8-b6fb-7af0d7b2a311 req-bc6eca34-4000-4489-86c4-7638b008a54d service nova] Acquiring lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6c110ad2-7766-4de8-b6fb-7af0d7b2a311 req-bc6eca34-4000-4489-86c4-7638b008a54d service nova] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6c110ad2-7766-4de8-b6fb-7af0d7b2a311 req-bc6eca34-4000-4489-86c4-7638b008a54d service nova] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-6c110ad2-7766-4de8-b6fb-7af0d7b2a311 req-bc6eca34-4000-4489-86c4-7638b008a54d service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] No waiting events found dispatching network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:10 user nova-compute[75006]: WARNING nova.compute.manager [req-6c110ad2-7766-4de8-b6fb-7af0d7b2a311 req-bc6eca34-4000-4489-86c4-7638b008a54d service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received unexpected event network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b for instance with vm_state active and task_state None.
Nov 27 03:18:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:18:11 user nova-compute[75006]: INFO nova.compute.claims [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Claim successful on node user
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:11 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance spawned successfully.
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Took 13.02 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Instance spawned successfully.
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.compute.manager [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Took 14.40 seconds to build instance.
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.network.neutron [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a7635597-2beb-49d5-a8c8-922ce1ba8b2c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.656s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-42098f57-68df-488f-a1b0-cedc50ece857 req-f4a94726-e75b-4a4d-8fa3-473cb506816b service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received event network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-42098f57-68df-488f-a1b0-cedc50ece857 req-f4a94726-e75b-4a4d-8fa3-473cb506816b service nova] Acquiring lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-42098f57-68df-488f-a1b0-cedc50ece857 req-f4a94726-e75b-4a4d-8fa3-473cb506816b service nova] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-42098f57-68df-488f-a1b0-cedc50ece857 req-f4a94726-e75b-4a4d-8fa3-473cb506816b service nova] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-42098f57-68df-488f-a1b0-cedc50ece857 req-f4a94726-e75b-4a4d-8fa3-473cb506816b service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] No waiting events found dispatching network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:12 user nova-compute[75006]: WARNING nova.compute.manager [req-42098f57-68df-488f-a1b0-cedc50ece857 req-f4a94726-e75b-4a4d-8fa3-473cb506816b service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received unexpected event network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b for instance with vm_state active and task_state None.
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance spawned successfully.
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Took 14.07 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Took 15.29 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Creating image(s)
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "/opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "/opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "/opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.068s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG nova.policy [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f150fc08fad489aa036b747757792f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358e4342c8a48ddb127bdaf5a9256a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.compute.manager [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Took 16.35 seconds to build instance.
Nov 27 03:18:12 user nova-compute[75006]: INFO nova.compute.manager [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Took 15.56 seconds to build instance.
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7174fbd4-2433-4e06-b618-d2b0e9491cc5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.506s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3249cc36-d651-4015-b310-9ae90cf8fe9a tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.714s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.315s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.009s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.217s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk 1073741824" returned: 0 in 0.102s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.226s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Successfully created port: db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Cannot resize image /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Ensure instance console log exists: /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:18:15 user nova-compute[75006]: INFO nova.compute.claims [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Claim successful on node user
Nov 27 03:18:15 user nova-compute[75006]: DEBUG nova.network.neutron [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Successfully updated port: db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquired lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG nova.network.neutron [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c72961c-8112-4d37-b4fb-ef304ad506c5 req-698bd4c1-a872-4059-bc7d-d6ea09c1419e service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received event network-changed-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c72961c-8112-4d37-b4fb-ef304ad506c5 req-698bd4c1-a872-4059-bc7d-d6ea09c1419e service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Refreshing instance network info cache due to event network-changed-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c72961c-8112-4d37-b4fb-ef304ad506c5 req-698bd4c1-a872-4059-bc7d-d6ea09c1419e service nova] Acquiring lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.network.neutron [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.666s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.network.neutron [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updating instance_info_cache with network_info: [{"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Releasing lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Instance network_info: |[{"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c72961c-8112-4d37-b4fb-ef304ad506c5 req-698bd4c1-a872-4059-bc7d-d6ea09c1419e service nova] Acquired lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-0c72961c-8112-4d37-b4fb-ef304ad506c5 req-698bd4c1-a872-4059-bc7d-d6ea09c1419e service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Refreshing network info cache for port db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Start _get_guest_xml network_info=[{"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:18:16 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:18:16 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:16 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1887490501',display_name='tempest-VolumesAdminNegativeTest-server-1887490501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1887490501',id=6,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlWJwS0YgOf7ZxOyzmv2cE4jjjnOwed68ctZbTmAkmzhm2wZBR2KJ+ohuYaYHMmb7nerMDgh1qfdvAMr3j0+nlns8j0ks/r1uvx18qUC8mCixy8IFoTKVY0dt0wc6gaRw==',key_name='tempest-keypair-424830851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a358e4342c8a48ddb127bdaf5a9256a8',ramdisk_id='',reservation_id='r-lfvagg2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1662628799',owner_user_name='tempest-VolumesAdminNegativeTest-1662628799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f150fc08fad489aa036b747757792f1',uuid=51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converting VIF {"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:35,bridge_name='br-int',has_traffic_filtering=True,id=db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb38f54c-ae') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.objects.instance [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lazy-loading 'pci_devices' on Instance uuid 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.policy [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e56b832c38c0462bb15023d0d4e70084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfbd2f7743454258944029eb9462d5fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:16 user nova-compute[75006]:   <uuid>51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7</uuid>
Nov 27 03:18:16 user nova-compute[75006]:   <name>instance-00000006</name>
Nov 27 03:18:16 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:16 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:16 user nova-compute[75006]:   <metadata>
Nov 27 03:18:16 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:16 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:16 user nova-compute[75006]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1887490501</nova:name>
Nov 27 03:18:16 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:16</nova:creationTime>
Nov 27 03:18:16 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:16 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:16 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:16 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:16 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:16 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:16 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:16 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:16 user nova-compute[75006]:         <nova:user uuid="4f150fc08fad489aa036b747757792f1">tempest-VolumesAdminNegativeTest-1662628799-project-member</nova:user>
Nov 27 03:18:16 user nova-compute[75006]:         <nova:project uuid="a358e4342c8a48ddb127bdaf5a9256a8">tempest-VolumesAdminNegativeTest-1662628799</nova:project>
Nov 27 03:18:16 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:16 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:18:16 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:16 user nova-compute[75006]:         <nova:port uuid="db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1">
Nov 27 03:18:16 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:18:16 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:16 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:16 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:16 user nova-compute[75006]:   </metadata>
Nov 27 03:18:16 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:16 user nova-compute[75006]:     <system>
Nov 27 03:18:16 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:16 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:16 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:16 user nova-compute[75006]:       <entry name="serial">51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7</entry>
Nov 27 03:18:16 user nova-compute[75006]:       <entry name="uuid">51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7</entry>
Nov 27 03:18:16 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:16 user nova-compute[75006]:     </system>
Nov 27 03:18:16 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:16 user nova-compute[75006]:   <os>
Nov 27 03:18:16 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:16 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:16 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:16 user nova-compute[75006]:   </os>
Nov 27 03:18:16 user nova-compute[75006]:   <features>
Nov 27 03:18:16 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:16 user nova-compute[75006]:     <apic/>
Nov 27 03:18:16 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:16 user nova-compute[75006]:   </features>
Nov 27 03:18:16 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:16 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:16 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:16 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:16 user nova-compute[75006]:   </clock>
Nov 27 03:18:16 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:16 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:16 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:16 user nova-compute[75006]:   </cpu>
Nov 27 03:18:16 user nova-compute[75006]:   <devices>
Nov 27 03:18:16 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:18:16 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:18:16 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk"/>
Nov 27 03:18:16 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:18:16 user nova-compute[75006]:     </disk>
Nov 27 03:18:16 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:16 user nova-compute[75006]:       <mac address="fa:16:3e:05:6e:35"/>
Nov 27 03:18:16 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:16 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:16 user nova-compute[75006]:       <target dev="tapdb38f54c-ae"/>
Nov 27 03:18:16 user nova-compute[75006]:     </interface>
Nov 27 03:18:16 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:16 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/console.log" append="off"/>
Nov 27 03:18:16 user nova-compute[75006]:     </serial>
Nov 27 03:18:16 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:16 user nova-compute[75006]:     <video>
Nov 27 03:18:16 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:16 user nova-compute[75006]:     </video>
Nov 27 03:18:16 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:16 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:16 user nova-compute[75006]:     </rng>
Nov 27 03:18:16 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:16 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:16 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:16 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:16 user nova-compute[75006]:   </devices>
Nov 27 03:18:16 user nova-compute[75006]: </domain>
Nov 27 03:18:16 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1887490501',display_name='tempest-VolumesAdminNegativeTest-server-1887490501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1887490501',id=6,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlWJwS0YgOf7ZxOyzmv2cE4jjjnOwed68ctZbTmAkmzhm2wZBR2KJ+ohuYaYHMmb7nerMDgh1qfdvAMr3j0+nlns8j0ks/r1uvx18qUC8mCixy8IFoTKVY0dt0wc6gaRw==',key_name='tempest-keypair-424830851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a358e4342c8a48ddb127bdaf5a9256a8',ramdisk_id='',reservation_id='r-lfvagg2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1662628799',owner_user_name='tempest-VolumesAdminNegativeTest-1662628799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f150fc08fad489aa036b747757792f1',uuid=51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converting VIF {"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:35,bridge_name='br-int',has_traffic_filtering=True,id=db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb38f54c-ae') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG os_vif [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:35,bridge_name='br-int',has_traffic_filtering=True,id=db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb38f54c-ae') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '001555b0-7575-5904-9642-87b6ae7ed821', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb38f54c-ae, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb38f54c-ae, col_values=(('qos', UUID('6fecfbf3-f250-47e9-b81a-d745fd188877')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb38f54c-ae, col_values=(('external_ids', {'iface-id': 'db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:6e:35', 'vm-uuid': '51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:16 user nova-compute[75006]: INFO os_vif [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:35,bridge_name='br-int',has_traffic_filtering=True,id=db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb38f54c-ae')
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:18:16 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Creating image(s)
Nov 27 03:18:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "/opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "/opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.028s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "e3ab4f0d09af59776b1f4f46b349ed92feaa1727" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "e3ab4f0d09af59776b1f4f46b349ed92feaa1727" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] No VIF found with MAC fa:16:3e:05:6e:35, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727.part --force-share --output=json" returned: 0 in 0.270s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:17 user nova-compute[75006]: DEBUG nova.virt.images [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] 6eba436a-817f-4b06-b7c1-03ab99ad8edf was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:18:17 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:18:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727.part /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:17 user nova-compute[75006]: DEBUG nova.network.neutron [req-0c72961c-8112-4d37-b4fb-ef304ad506c5 req-698bd4c1-a872-4059-bc7d-d6ea09c1419e service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updated VIF entry in instance network info cache for port db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:17 user nova-compute[75006]: DEBUG nova.network.neutron [req-0c72961c-8112-4d37-b4fb-ef304ad506c5 req-698bd4c1-a872-4059-bc7d-d6ea09c1419e service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updating instance_info_cache with network_info: [{"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c72961c-8112-4d37-b4fb-ef304ad506c5 req-698bd4c1-a872-4059-bc7d-d6ea09c1419e service nova] Releasing lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727.part /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727.converted" returned: 0 in 0.288s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "e3ab4f0d09af59776b1f4f46b349ed92feaa1727" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.372s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Successfully created port: 587db899-908f-449e-917e-5becb867f54d {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727 --force-share --output=json" returned: 0 in 0.243s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "e3ab4f0d09af59776b1f4f46b349ed92feaa1727" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "e3ab4f0d09af59776b1f4f46b349ed92feaa1727" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727 --force-share --output=json" returned: 0 in 0.292s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727,backing_fmt=raw /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727,backing_fmt=raw /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk 1073741824" returned: 0 in 0.092s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "e3ab4f0d09af59776b1f4f46b349ed92feaa1727" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727 --force-share --output=json" returned: 0 in 0.232s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Cannot resize image /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Ensure instance console log exists: /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Successfully updated port: 587db899-908f-449e-917e-5becb867f54d {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquired lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-6f70566f-3a65-4c8c-bd32-31f395447797 req-d465360d-4ab9-41cb-a540-b9e62abd6e78 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received event network-changed-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-6f70566f-3a65-4c8c-bd32-31f395447797 req-d465360d-4ab9-41cb-a540-b9e62abd6e78 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Refreshing instance network info cache due to event network-changed-587db899-908f-449e-917e-5becb867f54d. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6f70566f-3a65-4c8c-bd32-31f395447797 req-d465360d-4ab9-41cb-a540-b9e62abd6e78 service nova] Acquiring lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Updating instance_info_cache with network_info: [{"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Releasing lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Instance network_info: |[{"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6f70566f-3a65-4c8c-bd32-31f395447797 req-d465360d-4ab9-41cb-a540-b9e62abd6e78 service nova] Acquired lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.network.neutron [req-6f70566f-3a65-4c8c-bd32-31f395447797 req-d465360d-4ab9-41cb-a540-b9e62abd6e78 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Refreshing network info cache for port 587db899-908f-449e-917e-5becb867f54d {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Start _get_guest_xml network_info=[{"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:18:06Z,direct_url=<?>,disk_format='qcow2',id=6eba436a-817f-4b06-b7c1-03ab99ad8edf,min_disk=0,min_ram=0,name='',owner='cc2aece4f1ad4d73886cb7b4f408461e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:18:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/sda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6eba436a-817f-4b06-b7c1-03ab99ad8edf'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:20 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:20 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:18:06Z,direct_url=<?>,disk_format='qcow2',id=6eba436a-817f-4b06-b7c1-03ab99ad8edf,min_disk=0,min_ram=0,name='',owner='cc2aece4f1ad4d73886cb7b4f408461e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:18:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1544459975',display_name='tempest-AttachSCSIVolumeTestJSON-server-1544459975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1544459975',id=7,image_ref='6eba436a-817f-4b06-b7c1-03ab99ad8edf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObyERo+vGlsStXLA6JQ2lCgKIh65H6F8S4tz6h42FxXDUbugsZMbgzndgrDjP18Pu23ri0GDXL8lsFKrvCoipanIyLH8xJdEZWbK9B+fwWVMQ2kQ+6OCAJ27CiJPx7DMQ==',key_name='tempest-keypair-446293778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfbd2f7743454258944029eb9462d5fc',ramdisk_id='',reservation_id='r-61c7zphg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6eba436a-817f-4b06-b7c1-03ab99ad8edf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1280651358',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1280651358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56b832c38c0462bb15023d0d4e70084',uuid=6fb3b75d-a685-4aec-af12-b4c530695174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Converting VIF {"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:01,bridge_name='br-int',has_traffic_filtering=True,id=587db899-908f-449e-917e-5becb867f54d,network=Network(f080d0ff-8548-429b-9ea2-b9717a1aa5ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587db899-90') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fb3b75d-a685-4aec-af12-b4c530695174 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:20 user nova-compute[75006]:   <uuid>6fb3b75d-a685-4aec-af12-b4c530695174</uuid>
Nov 27 03:18:20 user nova-compute[75006]:   <name>instance-00000007</name>
Nov 27 03:18:20 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:20 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:20 user nova-compute[75006]:   <metadata>
Nov 27 03:18:20 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:20 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:20 user nova-compute[75006]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1544459975</nova:name>
Nov 27 03:18:20 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:20</nova:creationTime>
Nov 27 03:18:20 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:20 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:20 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:20 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:20 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:20 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:20 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:20 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:20 user nova-compute[75006]:         <nova:user uuid="e56b832c38c0462bb15023d0d4e70084">tempest-AttachSCSIVolumeTestJSON-1280651358-project-member</nova:user>
Nov 27 03:18:20 user nova-compute[75006]:         <nova:project uuid="bfbd2f7743454258944029eb9462d5fc">tempest-AttachSCSIVolumeTestJSON-1280651358</nova:project>
Nov 27 03:18:20 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:20 user nova-compute[75006]:       <nova:root type="image" uuid="6eba436a-817f-4b06-b7c1-03ab99ad8edf"/>
Nov 27 03:18:20 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:20 user nova-compute[75006]:         <nova:port uuid="587db899-908f-449e-917e-5becb867f54d">
Nov 27 03:18:20 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 03:18:20 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:20 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:20 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:20 user nova-compute[75006]:   </metadata>
Nov 27 03:18:20 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:20 user nova-compute[75006]:     <system>
Nov 27 03:18:20 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:20 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:20 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:20 user nova-compute[75006]:       <entry name="serial">6fb3b75d-a685-4aec-af12-b4c530695174</entry>
Nov 27 03:18:20 user nova-compute[75006]:       <entry name="uuid">6fb3b75d-a685-4aec-af12-b4c530695174</entry>
Nov 27 03:18:20 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:20 user nova-compute[75006]:     </system>
Nov 27 03:18:20 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:20 user nova-compute[75006]:   <os>
Nov 27 03:18:20 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:20 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:20 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:20 user nova-compute[75006]:   </os>
Nov 27 03:18:20 user nova-compute[75006]:   <features>
Nov 27 03:18:20 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:20 user nova-compute[75006]:     <apic/>
Nov 27 03:18:20 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:20 user nova-compute[75006]:   </features>
Nov 27 03:18:20 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:20 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:20 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:20 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:20 user nova-compute[75006]:   </clock>
Nov 27 03:18:20 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:20 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:20 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:20 user nova-compute[75006]:   </cpu>
Nov 27 03:18:20 user nova-compute[75006]:   <devices>
Nov 27 03:18:20 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:18:20 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:18:20 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk"/>
Nov 27 03:18:20 user nova-compute[75006]:       <target dev="sda" bus="scsi"/>
Nov 27 03:18:20 user nova-compute[75006]:       <address type="drive" controller="0" unit="0"/>
Nov 27 03:18:20 user nova-compute[75006]:     </disk>
Nov 27 03:18:20 user nova-compute[75006]:     <disk type="file" device="cdrom">
Nov 27 03:18:20 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 03:18:20 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk.config"/>
Nov 27 03:18:20 user nova-compute[75006]:       <target dev="sdb" bus="scsi"/>
Nov 27 03:18:20 user nova-compute[75006]:       <address type="drive" controller="0" unit="1"/>
Nov 27 03:18:20 user nova-compute[75006]:     </disk>
Nov 27 03:18:20 user nova-compute[75006]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 27 03:18:20 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:20 user nova-compute[75006]:       <mac address="fa:16:3e:57:f6:01"/>
Nov 27 03:18:20 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:20 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:20 user nova-compute[75006]:       <target dev="tap587db899-90"/>
Nov 27 03:18:20 user nova-compute[75006]:     </interface>
Nov 27 03:18:20 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:20 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/console.log" append="off"/>
Nov 27 03:18:20 user nova-compute[75006]:     </serial>
Nov 27 03:18:20 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:20 user nova-compute[75006]:     <video>
Nov 27 03:18:20 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:20 user nova-compute[75006]:     </video>
Nov 27 03:18:20 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:20 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:20 user nova-compute[75006]:     </rng>
Nov 27 03:18:20 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:20 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:20 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:20 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:20 user nova-compute[75006]:   </devices>
Nov 27 03:18:20 user nova-compute[75006]: </domain>
Nov 27 03:18:20 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1544459975',display_name='tempest-AttachSCSIVolumeTestJSON-server-1544459975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1544459975',id=7,image_ref='6eba436a-817f-4b06-b7c1-03ab99ad8edf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObyERo+vGlsStXLA6JQ2lCgKIh65H6F8S4tz6h42FxXDUbugsZMbgzndgrDjP18Pu23ri0GDXL8lsFKrvCoipanIyLH8xJdEZWbK9B+fwWVMQ2kQ+6OCAJ27CiJPx7DMQ==',key_name='tempest-keypair-446293778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bfbd2f7743454258944029eb9462d5fc',ramdisk_id='',reservation_id='r-61c7zphg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6eba436a-817f-4b06-b7c1-03ab99ad8edf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1280651358',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1280651358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56b832c38c0462bb15023d0d4e70084',uuid=6fb3b75d-a685-4aec-af12-b4c530695174,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Converting VIF {"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:01,bridge_name='br-int',has_traffic_filtering=True,id=587db899-908f-449e-917e-5becb867f54d,network=Network(f080d0ff-8548-429b-9ea2-b9717a1aa5ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587db899-90') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG os_vif [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:01,bridge_name='br-int',has_traffic_filtering=True,id=587db899-908f-449e-917e-5becb867f54d,network=Network(f080d0ff-8548-429b-9ea2-b9717a1aa5ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587db899-90') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '740c33cd-d750-502b-bfec-902180797d38', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap587db899-90, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap587db899-90, col_values=(('qos', UUID('d4f1c6e8-f9c0-4209-86e6-60c7402fde00')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap587db899-90, col_values=(('external_ids', {'iface-id': '587db899-908f-449e-917e-5becb867f54d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:f6:01', 'vm-uuid': '6fb3b75d-a685-4aec-af12-b4c530695174'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:20 user nova-compute[75006]: INFO os_vif [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:01,bridge_name='br-int',has_traffic_filtering=True,id=587db899-908f-449e-917e-5becb867f54d,network=Network(f080d0ff-8548-429b-9ea2-b9717a1aa5ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587db899-90')
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] No BDM found with device name sda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] No VIF found with MAC fa:16:3e:57:f6:01, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:20 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Using config drive
Nov 27 03:18:20 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Creating config drive at /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk.config
Nov 27 03:18:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpba_19qrb {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpba_19qrb" returned: 0 in 0.078s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.network.neutron [req-6f70566f-3a65-4c8c-bd32-31f395447797 req-d465360d-4ab9-41cb-a540-b9e62abd6e78 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Updated VIF entry in instance network info cache for port 587db899-908f-449e-917e-5becb867f54d. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.network.neutron [req-6f70566f-3a65-4c8c-bd32-31f395447797 req-d465360d-4ab9-41cb-a540-b9e62abd6e78 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Updating instance_info_cache with network_info: [{"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6f70566f-3a65-4c8c-bd32-31f395447797 req-d465360d-4ab9-41cb-a540-b9e62abd6e78 service nova] Releasing lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:18:21 user nova-compute[75006]: INFO nova.compute.claims [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Claim successful on node user
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Instance spawned successfully.
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:21 user nova-compute[75006]: INFO nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Took 9.31 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:18:22 user nova-compute[75006]: INFO nova.compute.manager [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Took 10.88 seconds to build instance.
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-91a540ca-7950-48c2-ae66-5c1ad693f58d tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.066s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:18:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:18:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Creating image(s)
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "/opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "/opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "/opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG nova.policy [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f84f6eae3fb74663ae52855de33ef727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d20b627f97e45c7aa1a3d3fd7dc9960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.315s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.361s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk 1073741824" returned: 0 in 0.103s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.475s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.532s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-11a0289a-a21a-4b8a-bbd6-5a3892e698eb req-d43f2236-26d7-4865-bac5-f84b183872ba service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received event network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-11a0289a-a21a-4b8a-bbd6-5a3892e698eb req-d43f2236-26d7-4865-bac5-f84b183872ba service nova] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-11a0289a-a21a-4b8a-bbd6-5a3892e698eb req-d43f2236-26d7-4865-bac5-f84b183872ba service nova] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-11a0289a-a21a-4b8a-bbd6-5a3892e698eb req-d43f2236-26d7-4865-bac5-f84b183872ba service nova] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-11a0289a-a21a-4b8a-bbd6-5a3892e698eb req-d43f2236-26d7-4865-bac5-f84b183872ba service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] No waiting events found dispatching network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:24 user nova-compute[75006]: WARNING nova.compute.manager [req-11a0289a-a21a-4b8a-bbd6-5a3892e698eb req-d43f2236-26d7-4865-bac5-f84b183872ba service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received unexpected event network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 for instance with vm_state active and task_state None.
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Cannot resize image /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Ensure instance console log exists: /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG nova.network.neutron [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Successfully created port: 84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:18:24 user nova-compute[75006]: INFO nova.compute.claims [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Claim successful on node user
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.810s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:18:25 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:18:25 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Creating image(s)
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "/opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "/opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "/opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG nova.policy [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2910ee7024114ce0a0a86ca217aa64ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e04dbb8754014588af0a6d6f9582640e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.219s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:25 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.280s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk 1073741824" returned: 0 in 0.080s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.371s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-26eeb3c2-a824-4238-b0c4-494af463cbf8 req-2d412670-24e6-4468-b5d3-19a8966d48f7 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received event network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26eeb3c2-a824-4238-b0c4-494af463cbf8 req-2d412670-24e6-4468-b5d3-19a8966d48f7 service nova] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26eeb3c2-a824-4238-b0c4-494af463cbf8 req-2d412670-24e6-4468-b5d3-19a8966d48f7 service nova] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26eeb3c2-a824-4238-b0c4-494af463cbf8 req-2d412670-24e6-4468-b5d3-19a8966d48f7 service nova] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-26eeb3c2-a824-4238-b0c4-494af463cbf8 req-2d412670-24e6-4468-b5d3-19a8966d48f7 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] No waiting events found dispatching network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:26 user nova-compute[75006]: WARNING nova.compute.manager [req-26eeb3c2-a824-4238-b0c4-494af463cbf8 req-2d412670-24e6-4468-b5d3-19a8966d48f7 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received unexpected event network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 for instance with vm_state active and task_state None.
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:26 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Instance spawned successfully.
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.network.neutron [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Successfully updated port: 84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquired lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.network.neutron [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.276s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:26 user nova-compute[75006]: INFO nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Took 9.60 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.network.neutron [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Cannot resize image /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Ensure instance console log exists: /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.008s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:26 user nova-compute[75006]: INFO nova.compute.manager [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Took 10.99 seconds to build instance.
Nov 27 03:18:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c0df6d65-587a-475d-a4b4-b73db5acec58 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.440s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:26 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Successfully created port: 7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.network.neutron [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Updating instance_info_cache with network_info: [{"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Releasing lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Instance network_info: |[{"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Start _get_guest_xml network_info=[{"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:27 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:27 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1324214563',display_name='tempest-TestVolumeSwap-server-1324214563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1324214563',id=8,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxtE4mKi8PFBXEO5JbRPT7BdXh2Jg+9OpJ/dw+rbmCtpJjlMAc0zcKzsNto0pPq7h/J8awJw6bRf2U9fcMiDLeBMTDnGBbWzw8dtEb5Kqn8UnVqIQMpiYeGeLm+sar3yg==',key_name='tempest-keypair-474088198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d20b627f97e45c7aa1a3d3fd7dc9960',ramdisk_id='',reservation_id='r-cnilo01a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-562406576',owner_user_name='tempest-TestVolumeSwap-562406576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f84f6eae3fb74663ae52855de33ef727',uuid=78af3b73-bce3-4e4b-b040-eda0d6af7050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Converting VIF {"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8f:68,bridge_name='br-int',has_traffic_filtering=True,id=84c13471-a593-4bf7-892c-caafa75901a4,network=Network(74d37221-e174-4385-aa63-0ee8a5f3415a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c13471-a5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.objects.instance [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lazy-loading 'pci_devices' on Instance uuid 78af3b73-bce3-4e4b-b040-eda0d6af7050 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:27 user nova-compute[75006]:   <uuid>78af3b73-bce3-4e4b-b040-eda0d6af7050</uuid>
Nov 27 03:18:27 user nova-compute[75006]:   <name>instance-00000008</name>
Nov 27 03:18:27 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:27 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:27 user nova-compute[75006]:   <metadata>
Nov 27 03:18:27 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:27 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:27 user nova-compute[75006]:       <nova:name>tempest-TestVolumeSwap-server-1324214563</nova:name>
Nov 27 03:18:27 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:27</nova:creationTime>
Nov 27 03:18:27 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:27 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:27 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:27 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:27 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:27 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:27 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:27 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:27 user nova-compute[75006]:         <nova:user uuid="f84f6eae3fb74663ae52855de33ef727">tempest-TestVolumeSwap-562406576-project-member</nova:user>
Nov 27 03:18:27 user nova-compute[75006]:         <nova:project uuid="7d20b627f97e45c7aa1a3d3fd7dc9960">tempest-TestVolumeSwap-562406576</nova:project>
Nov 27 03:18:27 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:27 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:18:27 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:27 user nova-compute[75006]:         <nova:port uuid="84c13471-a593-4bf7-892c-caafa75901a4">
Nov 27 03:18:27 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:18:27 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:27 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:27 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:27 user nova-compute[75006]:   </metadata>
Nov 27 03:18:27 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:27 user nova-compute[75006]:     <system>
Nov 27 03:18:27 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:27 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:27 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:27 user nova-compute[75006]:       <entry name="serial">78af3b73-bce3-4e4b-b040-eda0d6af7050</entry>
Nov 27 03:18:27 user nova-compute[75006]:       <entry name="uuid">78af3b73-bce3-4e4b-b040-eda0d6af7050</entry>
Nov 27 03:18:27 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:27 user nova-compute[75006]:     </system>
Nov 27 03:18:27 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:27 user nova-compute[75006]:   <os>
Nov 27 03:18:27 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:27 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:27 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:27 user nova-compute[75006]:   </os>
Nov 27 03:18:27 user nova-compute[75006]:   <features>
Nov 27 03:18:27 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:27 user nova-compute[75006]:     <apic/>
Nov 27 03:18:27 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:27 user nova-compute[75006]:   </features>
Nov 27 03:18:27 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:27 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:27 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:27 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:27 user nova-compute[75006]:   </clock>
Nov 27 03:18:27 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:27 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:27 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:27 user nova-compute[75006]:   </cpu>
Nov 27 03:18:27 user nova-compute[75006]:   <devices>
Nov 27 03:18:27 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:18:27 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:18:27 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk"/>
Nov 27 03:18:27 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:18:27 user nova-compute[75006]:     </disk>
Nov 27 03:18:27 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:27 user nova-compute[75006]:       <mac address="fa:16:3e:29:8f:68"/>
Nov 27 03:18:27 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:27 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:27 user nova-compute[75006]:       <target dev="tap84c13471-a5"/>
Nov 27 03:18:27 user nova-compute[75006]:     </interface>
Nov 27 03:18:27 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:27 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/console.log" append="off"/>
Nov 27 03:18:27 user nova-compute[75006]:     </serial>
Nov 27 03:18:27 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:27 user nova-compute[75006]:     <video>
Nov 27 03:18:27 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:27 user nova-compute[75006]:     </video>
Nov 27 03:18:27 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:27 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:27 user nova-compute[75006]:     </rng>
Nov 27 03:18:27 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:27 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:27 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:27 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:27 user nova-compute[75006]:   </devices>
Nov 27 03:18:27 user nova-compute[75006]: </domain>
Nov 27 03:18:27 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1324214563',display_name='tempest-TestVolumeSwap-server-1324214563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1324214563',id=8,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxtE4mKi8PFBXEO5JbRPT7BdXh2Jg+9OpJ/dw+rbmCtpJjlMAc0zcKzsNto0pPq7h/J8awJw6bRf2U9fcMiDLeBMTDnGBbWzw8dtEb5Kqn8UnVqIQMpiYeGeLm+sar3yg==',key_name='tempest-keypair-474088198',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d20b627f97e45c7aa1a3d3fd7dc9960',ramdisk_id='',reservation_id='r-cnilo01a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-562406576',owner_user_name='tempest-TestVolumeSwap-562406576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f84f6eae3fb74663ae52855de33ef727',uuid=78af3b73-bce3-4e4b-b040-eda0d6af7050,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Converting VIF {"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:8f:68,bridge_name='br-int',has_traffic_filtering=True,id=84c13471-a593-4bf7-892c-caafa75901a4,network=Network(74d37221-e174-4385-aa63-0ee8a5f3415a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c13471-a5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG os_vif [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8f:68,bridge_name='br-int',has_traffic_filtering=True,id=84c13471-a593-4bf7-892c-caafa75901a4,network=Network(74d37221-e174-4385-aa63-0ee8a5f3415a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c13471-a5') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd77a1fff-7095-5605-b964-fe5b4d16472e', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c13471-a5, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c13471-a5, col_values=(('qos', UUID('feb36201-47fe-493e-b6a6-09b67f433008')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c13471-a5, col_values=(('external_ids', {'iface-id': '84c13471-a593-4bf7-892c-caafa75901a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:8f:68', 'vm-uuid': '78af3b73-bce3-4e4b-b040-eda0d6af7050'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:27 user nova-compute[75006]: INFO os_vif [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:8f:68,bridge_name='br-int',has_traffic_filtering=True,id=84c13471-a593-4bf7-892c-caafa75901a4,network=Network(74d37221-e174-4385-aa63-0ee8a5f3415a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c13471-a5')
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] No VIF found with MAC fa:16:3e:29:8f:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "503a960f-c3f6-4b8f-af89-7796916be32c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.compute.manager [req-01443aa8-f855-4e03-8630-f131aeb20b70 req-00002d79-fb2e-413b-af94-5aba7cc833cc service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Received event network-changed-84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.compute.manager [req-01443aa8-f855-4e03-8630-f131aeb20b70 req-00002d79-fb2e-413b-af94-5aba7cc833cc service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Refreshing instance network info cache due to event network-changed-84c13471-a593-4bf7-892c-caafa75901a4. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-01443aa8-f855-4e03-8630-f131aeb20b70 req-00002d79-fb2e-413b-af94-5aba7cc833cc service nova] Acquiring lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-01443aa8-f855-4e03-8630-f131aeb20b70 req-00002d79-fb2e-413b-af94-5aba7cc833cc service nova] Acquired lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.network.neutron [req-01443aa8-f855-4e03-8630-f131aeb20b70 req-00002d79-fb2e-413b-af94-5aba7cc833cc service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Refreshing network info cache for port 84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Successfully updated port: 7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquired lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.compute.manager [req-ad9d83ab-9fec-488c-8213-0e57a39d6df4 req-26e4b459-31e8-4429-9fd6-98b9b9d81f1c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received event network-changed-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.compute.manager [req-ad9d83ab-9fec-488c-8213-0e57a39d6df4 req-26e4b459-31e8-4429-9fd6-98b9b9d81f1c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Refreshing instance network info cache due to event network-changed-7b14e158-9ba1-4ca2-945c-fd79fe5f3452. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ad9d83ab-9fec-488c-8213-0e57a39d6df4 req-26e4b459-31e8-4429-9fd6-98b9b9d81f1c service nova] Acquiring lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:18:28 user nova-compute[75006]: INFO nova.compute.claims [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Claim successful on node user
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:18:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Updating instance_info_cache with network_info: [{"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Releasing lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Instance network_info: |[{"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ad9d83ab-9fec-488c-8213-0e57a39d6df4 req-26e4b459-31e8-4429-9fd6-98b9b9d81f1c service nova] Acquired lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.neutron [req-ad9d83ab-9fec-488c-8213-0e57a39d6df4 req-26e4b459-31e8-4429-9fd6-98b9b9d81f1c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Refreshing network info cache for port 7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Start _get_guest_xml network_info=[{"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.neutron [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:18:29 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:18:29 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:29 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1949820348',display_name='tempest-VolumesAssistedSnapshotsTest-server-1949820348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1949820348',id=9,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkkCUNGzotbAQ1sr/JVoPSaU89h6r7/r256Dz4phDCYNkfNiJGyEKNvLbMioHxLIeCWaC/7d7GZrOOM5NBVID4T4/GggyWdnFQhnVJuZF7OK0G6fOjIIQAGsWlBLbD/cA==',key_name='tempest-keypair-44339890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e04dbb8754014588af0a6d6f9582640e',ramdisk_id='',reservation_id='r-h7o30y6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-381108971',owner_user_name='tempest-VolumesAssistedSnapshotsTest-381108971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2910ee7024114ce0a0a86ca217aa64ed',uuid=8192463c-0589-4a75-97ec-24a5d9149c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Converting VIF {"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:57:68,bridge_name='br-int',has_traffic_filtering=True,id=7b14e158-9ba1-4ca2-945c-fd79fe5f3452,network=Network(439014dd-9312-44d9-90b0-15d9370c0d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b14e158-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lazy-loading 'pci_devices' on Instance uuid 8192463c-0589-4a75-97ec-24a5d9149c7f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.neutron [req-01443aa8-f855-4e03-8630-f131aeb20b70 req-00002d79-fb2e-413b-af94-5aba7cc833cc service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Updated VIF entry in instance network info cache for port 84c13471-a593-4bf7-892c-caafa75901a4. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.neutron [req-01443aa8-f855-4e03-8630-f131aeb20b70 req-00002d79-fb2e-413b-af94-5aba7cc833cc service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Updating instance_info_cache with network_info: [{"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:29 user nova-compute[75006]:   <uuid>8192463c-0589-4a75-97ec-24a5d9149c7f</uuid>
Nov 27 03:18:29 user nova-compute[75006]:   <name>instance-00000009</name>
Nov 27 03:18:29 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:29 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:29 user nova-compute[75006]:   <metadata>
Nov 27 03:18:29 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:29 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:29 user nova-compute[75006]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1949820348</nova:name>
Nov 27 03:18:29 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:29</nova:creationTime>
Nov 27 03:18:29 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:29 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:29 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:29 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:29 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:29 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:29 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:29 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:29 user nova-compute[75006]:         <nova:user uuid="2910ee7024114ce0a0a86ca217aa64ed">tempest-VolumesAssistedSnapshotsTest-381108971-project-member</nova:user>
Nov 27 03:18:29 user nova-compute[75006]:         <nova:project uuid="e04dbb8754014588af0a6d6f9582640e">tempest-VolumesAssistedSnapshotsTest-381108971</nova:project>
Nov 27 03:18:29 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:29 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:18:29 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:29 user nova-compute[75006]:         <nova:port uuid="7b14e158-9ba1-4ca2-945c-fd79fe5f3452">
Nov 27 03:18:29 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 03:18:29 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:29 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:29 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:29 user nova-compute[75006]:   </metadata>
Nov 27 03:18:29 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:29 user nova-compute[75006]:     <system>
Nov 27 03:18:29 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:29 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:29 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:29 user nova-compute[75006]:       <entry name="serial">8192463c-0589-4a75-97ec-24a5d9149c7f</entry>
Nov 27 03:18:29 user nova-compute[75006]:       <entry name="uuid">8192463c-0589-4a75-97ec-24a5d9149c7f</entry>
Nov 27 03:18:29 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:29 user nova-compute[75006]:     </system>
Nov 27 03:18:29 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:29 user nova-compute[75006]:   <os>
Nov 27 03:18:29 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:29 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:29 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:29 user nova-compute[75006]:   </os>
Nov 27 03:18:29 user nova-compute[75006]:   <features>
Nov 27 03:18:29 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:29 user nova-compute[75006]:     <apic/>
Nov 27 03:18:29 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:29 user nova-compute[75006]:   </features>
Nov 27 03:18:29 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:29 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:29 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:29 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:29 user nova-compute[75006]:   </clock>
Nov 27 03:18:29 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:29 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:29 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:29 user nova-compute[75006]:   </cpu>
Nov 27 03:18:29 user nova-compute[75006]:   <devices>
Nov 27 03:18:29 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:18:29 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:18:29 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk"/>
Nov 27 03:18:29 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:18:29 user nova-compute[75006]:     </disk>
Nov 27 03:18:29 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:29 user nova-compute[75006]:       <mac address="fa:16:3e:fd:57:68"/>
Nov 27 03:18:29 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:29 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:29 user nova-compute[75006]:       <target dev="tap7b14e158-9b"/>
Nov 27 03:18:29 user nova-compute[75006]:     </interface>
Nov 27 03:18:29 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:29 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/console.log" append="off"/>
Nov 27 03:18:29 user nova-compute[75006]:     </serial>
Nov 27 03:18:29 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:29 user nova-compute[75006]:     <video>
Nov 27 03:18:29 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:29 user nova-compute[75006]:     </video>
Nov 27 03:18:29 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:29 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:29 user nova-compute[75006]:     </rng>
Nov 27 03:18:29 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:29 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:29 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:29 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:29 user nova-compute[75006]:   </devices>
Nov 27 03:18:29 user nova-compute[75006]: </domain>
Nov 27 03:18:29 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1949820348',display_name='tempest-VolumesAssistedSnapshotsTest-server-1949820348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1949820348',id=9,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkkCUNGzotbAQ1sr/JVoPSaU89h6r7/r256Dz4phDCYNkfNiJGyEKNvLbMioHxLIeCWaC/7d7GZrOOM5NBVID4T4/GggyWdnFQhnVJuZF7OK0G6fOjIIQAGsWlBLbD/cA==',key_name='tempest-keypair-44339890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e04dbb8754014588af0a6d6f9582640e',ramdisk_id='',reservation_id='r-h7o30y6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-381108971',owner_user_name='tempest-VolumesAssistedSnapshotsTest-381108971-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2910ee7024114ce0a0a86ca217aa64ed',uuid=8192463c-0589-4a75-97ec-24a5d9149c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Converting VIF {"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:57:68,bridge_name='br-int',has_traffic_filtering=True,id=7b14e158-9ba1-4ca2-945c-fd79fe5f3452,network=Network(439014dd-9312-44d9-90b0-15d9370c0d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b14e158-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG os_vif [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:57:68,bridge_name='br-int',has_traffic_filtering=True,id=7b14e158-9ba1-4ca2-945c-fd79fe5f3452,network=Network(439014dd-9312-44d9-90b0-15d9370c0d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b14e158-9b') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-01443aa8-f855-4e03-8630-f131aeb20b70 req-00002d79-fb2e-413b-af94-5aba7cc833cc service nova] Releasing lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b34b2b6e-c099-51df-b2b3-8f43507685a1', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.policy [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '693d59e66f9e41478ce9a1d199f7633d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f859896de4a04f35a385b771412f684a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: INFO nova.virt.block_device [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Booting with volume 13409c5f-0143-40b9-92f9-42dea666781d at /dev/vda
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b14e158-9b, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b14e158-9b, col_values=(('qos', UUID('d3f21a21-0da5-4eef-bc6f-4dda81f265e8')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b14e158-9b, col_values=(('external_ids', {'iface-id': '7b14e158-9ba1-4ca2-945c-fd79fe5f3452', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:57:68', 'vm-uuid': '8192463c-0589-4a75-97ec-24a5d9149c7f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:29 user nova-compute[75006]: INFO os_vif [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:57:68,bridge_name='br-int',has_traffic_filtering=True,id=7b14e158-9ba1-4ca2-945c-fd79fe5f3452,network=Network(439014dd-9312-44d9-90b0-15d9370c0d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b14e158-9b')
Nov 27 03:18:29 user nova-compute[75006]: DEBUG os_brick.utils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:18:29 user nova-compute[75006]: INFO oslo.privsep.daemon [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpsupk2jbf/privsep.sock']
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] No VIF found with MAC fa:16:3e:fd:57:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:29 user sudo[85548]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpsupk2jbf/privsep.sock
Nov 27 03:18:29 user sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 03:18:30 user nova-compute[75006]: DEBUG nova.network.neutron [req-ad9d83ab-9fec-488c-8213-0e57a39d6df4 req-26e4b459-31e8-4429-9fd6-98b9b9d81f1c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Updated VIF entry in instance network info cache for port 7b14e158-9ba1-4ca2-945c-fd79fe5f3452. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:30 user nova-compute[75006]: DEBUG nova.network.neutron [req-ad9d83ab-9fec-488c-8213-0e57a39d6df4 req-26e4b459-31e8-4429-9fd6-98b9b9d81f1c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Updating instance_info_cache with network_info: [{"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ad9d83ab-9fec-488c-8213-0e57a39d6df4 req-26e4b459-31e8-4429-9fd6-98b9b9d81f1c service nova] Releasing lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:30 user nova-compute[75006]: DEBUG nova.network.neutron [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Successfully created port: 1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:31 user sudo[85548]: pam_unix(sudo:session): session closed for user root
Nov 27 03:18:31 user nova-compute[75006]: INFO oslo.privsep.daemon [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Spawned new privsep daemon via rootwrap
Nov 27 03:18:31 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 03:18:31 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 03:18:31 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 27 03:18:31 user nova-compute[75006]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85775
Nov 27 03:18:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05627ee-ce74-4145-82c4-a6a92eee2c31]: (2,) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG nova.network.neutron [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Successfully updated port: 1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquired lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG nova.network.neutron [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-68828e76-e467-4775-b8ec-d983dd528ef3 req-7706251d-fa24-4931-8af5-b01a3d391c0a service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-changed-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-68828e76-e467-4775-b8ec-d983dd528ef3 req-7706251d-fa24-4931-8af5-b01a3d391c0a service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Refreshing instance network info cache due to event network-changed-1856fd0c-42fd-44e2-b937-2bf7564d7f13. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-68828e76-e467-4775-b8ec-d983dd528ef3 req-7706251d-fa24-4931-8af5-b01a3d391c0a service nova] Acquiring lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG nova.network.neutron [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe556f44-7618-45c3-baaa-93245427d200]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:31 user nova-compute[75006]: WARNING os_brick.initiator.connectors.nvmeof [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a467301b-ef71-450b-a81e-b95f13e19a54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4db7afe-cad6-46d6-98f5-db8bdf83ea72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf66268-f6ee-4b13-a2f4-749e5a105707]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:18:31 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:18:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[456a43e0-2738-4ee3-b31d-fcb8e7d37cac]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG os_brick.utils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] <== get_connector_properties: return (2125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Updating existing volume attachment record: a5784785-e474-42d8-8a5e-6311817cc61b {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG nova.network.neutron [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Updating instance_info_cache with network_info: [{"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Releasing lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance network_info: |[{"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-68828e76-e467-4775-b8ec-d983dd528ef3 req-7706251d-fa24-4931-8af5-b01a3d391c0a service nova] Acquired lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG nova.network.neutron [req-68828e76-e467-4775-b8ec-d983dd528ef3 req-7706251d-fa24-4931-8af5-b01a3d391c0a service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Refreshing network info cache for port 1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-28d652ed-be13-4e7c-9524-26a614c298ea req-a6c94097-816f-4437-8112-4cc777da65e5 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-28d652ed-be13-4e7c-9524-26a614c298ea req-a6c94097-816f-4437-8112-4cc777da65e5 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-28d652ed-be13-4e7c-9524-26a614c298ea req-a6c94097-816f-4437-8112-4cc777da65e5 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-28d652ed-be13-4e7c-9524-26a614c298ea req-a6c94097-816f-4437-8112-4cc777da65e5 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-28d652ed-be13-4e7c-9524-26a614c298ea req-a6c94097-816f-4437-8112-4cc777da65e5 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:32 user nova-compute[75006]: WARNING nova.compute.manager [req-28d652ed-be13-4e7c-9524-26a614c298ea req-a6c94097-816f-4437-8112-4cc777da65e5 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state active and task_state None.
Nov 27 03:18:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG nova.network.neutron [req-68828e76-e467-4775-b8ec-d983dd528ef3 req-7706251d-fa24-4931-8af5-b01a3d391c0a service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Updated VIF entry in instance network info cache for port 1856fd0c-42fd-44e2-b937-2bf7564d7f13. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG nova.network.neutron [req-68828e76-e467-4775-b8ec-d983dd528ef3 req-7706251d-fa24-4931-8af5-b01a3d391c0a service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Updating instance_info_cache with network_info: [{"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-68828e76-e467-4775-b8ec-d983dd528ef3 req-7706251d-fa24-4931-8af5-b01a3d391c0a service nova] Releasing lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Instance spawned successfully.
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:33 user nova-compute[75006]: INFO nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Took 10.80 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:33 user nova-compute[75006]: INFO nova.compute.manager [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Took 12.08 seconds to build instance.
Nov 27 03:18:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-92c0a761-3004-4bc4-a000-b1b8bc08b168 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.312s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:34 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Instance spawned successfully.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:34 user nova-compute[75006]: INFO nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Took 8.93 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state active and task_state None.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received event network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] No waiting events found dispatching network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received unexpected event network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 for instance with vm_state active and task_state None.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received event network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] No waiting events found dispatching network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received unexpected event network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 for instance with vm_state active and task_state None.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received event network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] No waiting events found dispatching network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received unexpected event network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 for instance with vm_state active and task_state None.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received event network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] No waiting events found dispatching network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received unexpected event network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 for instance with vm_state active and task_state None.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received event network-vif-plugged-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] No waiting events found dispatching network-vif-plugged-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received unexpected event network-vif-plugged-587db899-908f-449e-917e-5becb867f54d for instance with vm_state active and task_state None.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received event network-vif-plugged-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] No waiting events found dispatching network-vif-plugged-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received unexpected event network-vif-plugged-587db899-908f-449e-917e-5becb867f54d for instance with vm_state active and task_state None.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received event network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] No waiting events found dispatching network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received unexpected event network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 for instance with vm_state building and task_state spawning.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received event network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] No waiting events found dispatching network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:34 user nova-compute[75006]: WARNING nova.compute.manager [req-3126c492-c682-43c6-ae89-c4d47d607c2a req-84c83fe7-1413-4ee5-8fca-205d620d807c service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received unexpected event network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 for instance with vm_state building and task_state spawning.
Nov 27 03:18:34 user nova-compute[75006]: INFO nova.compute.manager [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Took 10.28 seconds to build instance.
Nov 27 03:18:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ce1ca06-4834-43a9-bacb-6645f1de1a80 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.534s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:18:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:18:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:18:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:18:40 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Creating image(s)
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Ensure instance console log exists: /opt/stack/data/nova/instances/503a960f-c3f6-4b8f-af89-7796916be32c/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Start _get_guest_xml network_info=[{"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'a5784785-e474-42d8-8a5e-6311817cc61b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '503a960f-c3f6-4b8f-af89-7796916be32c', 'attached_at': '', 'detached_at': '', 'volume_id': '13409c5f-0143-40b9-92f9-42dea666781d', 'serial': '13409c5f-0143-40b9-92f9-42dea666781d'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:40 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:40 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connector [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Factory for ISCSI on None {{(pid=75006) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:18:40 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:18:40 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:18:40 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8012d8-67d3-4fc6-a4bb-954a553c9408]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:18:40 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f46763f-68dd-4efb-aa4b-d9b59108ed81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d] added
Nov 27 03:18:40 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5104ec4-773e-4904-a6e5-8e62c9e8f317]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd32eb-b5e8-4d61-865c-8798bd5e6ca2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TURPKwXD {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TURPKwXD" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8030fccd-d758-425b-9fc3-371e36f3bca0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TURPKwXD'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d47072-b07b-458c-bf49-fde7f561419d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c971bf06-23e5-4924-9eb2-2dc573b8ef22]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 03:18:40 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 03:18:40 user nova-compute[75006]:  {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:18:40 user nova-compute[75006]: WARNING os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 03:18:40 user nova-compute[75006]: 
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cd97a0-653d-4320-be19-6e80ed624291]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260]
Nov 27 03:18:40 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260] successful.
Nov 27 03:18:40 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9c1ebf-5a7a-444b-b27b-081ec6da7779]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5e9c2c-3f22-4ebc-819a-d37c3453d6ff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:18:40 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:18:40 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acaf35c-760d-48b7-95bf-b5a55b67eade]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8b3b5b6-cc8b-45ac-a2eb-790abdc966f9 req-606bfe2c-012c-45f7-bbc9-cf52424d04f5 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8b3b5b6-cc8b-45ac-a2eb-790abdc966f9 req-606bfe2c-012c-45f7-bbc9-cf52424d04f5 service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8b3b5b6-cc8b-45ac-a2eb-790abdc966f9 req-606bfe2c-012c-45f7-bbc9-cf52424d04f5 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8b3b5b6-cc8b-45ac-a2eb-790abdc966f9 req-606bfe2c-012c-45f7-bbc9-cf52424d04f5 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8b3b5b6-cc8b-45ac-a2eb-790abdc966f9 req-606bfe2c-012c-45f7-bbc9-cf52424d04f5 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:41 user nova-compute[75006]: WARNING nova.compute.manager [req-e8b3b5b6-cc8b-45ac-a2eb-790abdc966f9 req-606bfe2c-012c-45f7-bbc9-cf52424d04f5 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state active and task_state None.
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23563323566326266', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563323566326266', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1739552079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1739552079',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEwjlY0CoUcygTkC5MyCYRqbOE6ERSsD3pzuc1AA/39Q08Ghvl6YSDYF0crP8xc6jrODLO9Q5HWNs2BEYtVvjp1IiwJwNqfALKa03qefDLZ2IO8YLyjexGBUJf2j1WyOg==',key_name='tempest-keypair-1820861676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f859896de4a04f35a385b771412f684a',ramdisk_id='',reservation_id='r-7qq7bj0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-647617165',owner_user_name='tempest-ServerActionsV293TestJSON-647617165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693d59e66f9e41478ce9a1d199f7633d',uuid=503a960f-c3f6-4b8f-af89-7796916be32c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converting VIF {"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lazy-loading 'pci_devices' on Instance uuid 503a960f-c3f6-4b8f-af89-7796916be32c {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:42 user nova-compute[75006]:   <uuid>503a960f-c3f6-4b8f-af89-7796916be32c</uuid>
Nov 27 03:18:42 user nova-compute[75006]:   <name>instance-0000000a</name>
Nov 27 03:18:42 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:42 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:42 user nova-compute[75006]:   <metadata>
Nov 27 03:18:42 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:42 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:42 user nova-compute[75006]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1739552079</nova:name>
Nov 27 03:18:42 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:40</nova:creationTime>
Nov 27 03:18:42 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:42 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:42 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:42 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:42 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:42 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:42 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:42 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:42 user nova-compute[75006]:         <nova:user uuid="693d59e66f9e41478ce9a1d199f7633d">tempest-ServerActionsV293TestJSON-647617165-project-member</nova:user>
Nov 27 03:18:42 user nova-compute[75006]:         <nova:project uuid="f859896de4a04f35a385b771412f684a">tempest-ServerActionsV293TestJSON-647617165</nova:project>
Nov 27 03:18:42 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:42 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:42 user nova-compute[75006]:         <nova:port uuid="1856fd0c-42fd-44e2-b937-2bf7564d7f13">
Nov 27 03:18:42 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 03:18:42 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:42 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:42 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:42 user nova-compute[75006]:   </metadata>
Nov 27 03:18:42 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:42 user nova-compute[75006]:     <system>
Nov 27 03:18:42 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:42 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:42 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:42 user nova-compute[75006]:       <entry name="serial">503a960f-c3f6-4b8f-af89-7796916be32c</entry>
Nov 27 03:18:42 user nova-compute[75006]:       <entry name="uuid">503a960f-c3f6-4b8f-af89-7796916be32c</entry>
Nov 27 03:18:42 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:42 user nova-compute[75006]:     </system>
Nov 27 03:18:42 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:42 user nova-compute[75006]:   <os>
Nov 27 03:18:42 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:42 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:42 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:42 user nova-compute[75006]:   </os>
Nov 27 03:18:42 user nova-compute[75006]:   <features>
Nov 27 03:18:42 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:42 user nova-compute[75006]:     <apic/>
Nov 27 03:18:42 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:42 user nova-compute[75006]:   </features>
Nov 27 03:18:42 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:42 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:42 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:42 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:42 user nova-compute[75006]:   </clock>
Nov 27 03:18:42 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:42 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:42 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:42 user nova-compute[75006]:   </cpu>
Nov 27 03:18:42 user nova-compute[75006]:   <devices>
Nov 27 03:18:42 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:18:42 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:18:42 user nova-compute[75006]:       <source dev="/dev/sdb"/>
Nov 27 03:18:42 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:18:42 user nova-compute[75006]:       <serial>13409c5f-0143-40b9-92f9-42dea666781d</serial>
Nov 27 03:18:42 user nova-compute[75006]:     </disk>
Nov 27 03:18:42 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:42 user nova-compute[75006]:       <mac address="fa:16:3e:2a:05:68"/>
Nov 27 03:18:42 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:42 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:42 user nova-compute[75006]:       <target dev="tap1856fd0c-42"/>
Nov 27 03:18:42 user nova-compute[75006]:     </interface>
Nov 27 03:18:42 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:42 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/503a960f-c3f6-4b8f-af89-7796916be32c/console.log" append="off"/>
Nov 27 03:18:42 user nova-compute[75006]:     </serial>
Nov 27 03:18:42 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:42 user nova-compute[75006]:     <video>
Nov 27 03:18:42 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:42 user nova-compute[75006]:     </video>
Nov 27 03:18:42 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:42 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:42 user nova-compute[75006]:     </rng>
Nov 27 03:18:42 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:42 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:42 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:42 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:42 user nova-compute[75006]:   </devices>
Nov 27 03:18:42 user nova-compute[75006]: </domain>
Nov 27 03:18:42 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1739552079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1739552079',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEwjlY0CoUcygTkC5MyCYRqbOE6ERSsD3pzuc1AA/39Q08Ghvl6YSDYF0crP8xc6jrODLO9Q5HWNs2BEYtVvjp1IiwJwNqfALKa03qefDLZ2IO8YLyjexGBUJf2j1WyOg==',key_name='tempest-keypair-1820861676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f859896de4a04f35a385b771412f684a',ramdisk_id='',reservation_id='r-7qq7bj0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-647617165',owner_user_name='tempest-ServerActionsV293TestJSON-647617165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693d59e66f9e41478ce9a1d199f7633d',uuid=503a960f-c3f6-4b8f-af89-7796916be32c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converting VIF {"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG os_vif [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '288f85c3-93e1-5b4b-a7d3-657965cc2f87', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1856fd0c-42, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1856fd0c-42, col_values=(('qos', UUID('ff5421dd-ced6-4097-8f4d-193dc10e0b7e')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1856fd0c-42, col_values=(('external_ids', {'iface-id': '1856fd0c-42fd-44e2-b937-2bf7564d7f13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:05:68', 'vm-uuid': '503a960f-c3f6-4b8f-af89-7796916be32c'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:42 user nova-compute[75006]: INFO os_vif [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42')
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] No VIF found with MAC fa:16:3e:2a:05:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:43 user nova-compute[75006]: WARNING nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state active and task_state None.
Nov 27 03:18:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Received event network-vif-plugged-84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] No waiting events found dispatching network-vif-plugged-84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:43 user nova-compute[75006]: WARNING nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Received unexpected event network-vif-plugged-84c13471-a593-4bf7-892c-caafa75901a4 for instance with vm_state active and task_state None.
Nov 27 03:18:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Received event network-vif-plugged-84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] No waiting events found dispatching network-vif-plugged-84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:43 user nova-compute[75006]: WARNING nova.compute.manager [req-f286a5b2-2e9a-429b-b523-98ebdc805a85 req-ee1fc8d3-4bb1-4038-87cb-ec372d034e00 service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Received unexpected event network-vif-plugged-84c13471-a593-4bf7-892c-caafa75901a4 for instance with vm_state active and task_state None.
Nov 27 03:18:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-05eceed0-834a-4122-b4e1-1f9aecf4a7ec req-538bc76a-6187-4a4b-abde-c890733aa727 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-05eceed0-834a-4122-b4e1-1f9aecf4a7ec req-538bc76a-6187-4a4b-abde-c890733aa727 service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-05eceed0-834a-4122-b4e1-1f9aecf4a7ec req-538bc76a-6187-4a4b-abde-c890733aa727 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-05eceed0-834a-4122-b4e1-1f9aecf4a7ec req-538bc76a-6187-4a4b-abde-c890733aa727 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-05eceed0-834a-4122-b4e1-1f9aecf4a7ec req-538bc76a-6187-4a4b-abde-c890733aa727 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] No waiting events found dispatching network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:44 user nova-compute[75006]: WARNING nova.compute.manager [req-05eceed0-834a-4122-b4e1-1f9aecf4a7ec req-538bc76a-6187-4a4b-abde-c890733aa727 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received unexpected event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 for instance with vm_state building and task_state spawning.
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:45 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:45 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7394MB free_disk=25.686866760253906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fd992ae2-0b97-47d2-9e03-f707af65f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5ee0634e-e918-4e98-a42c-496e3f7de095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6fb3b75d-a685-4aec-af12-b4c530695174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 8192463c-0589-4a75-97ec-24a5d9149c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 503a960f-c3f6-4b8f-af89-7796916be32c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:18:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance spawned successfully.
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:18:45 user nova-compute[75006]: INFO nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 27 03:18:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-813e2658-b28b-4615-b2ce-49fdbbc33c5f req-20bdedb3-1067-45db-a2ef-894919763a11 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-813e2658-b28b-4615-b2ce-49fdbbc33c5f req-20bdedb3-1067-45db-a2ef-894919763a11 service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-813e2658-b28b-4615-b2ce-49fdbbc33c5f req-20bdedb3-1067-45db-a2ef-894919763a11 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-813e2658-b28b-4615-b2ce-49fdbbc33c5f req-20bdedb3-1067-45db-a2ef-894919763a11 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-813e2658-b28b-4615-b2ce-49fdbbc33c5f req-20bdedb3-1067-45db-a2ef-894919763a11 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] No waiting events found dispatching network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:18:46 user nova-compute[75006]: WARNING nova.compute.manager [req-813e2658-b28b-4615-b2ce-49fdbbc33c5f req-20bdedb3-1067-45db-a2ef-894919763a11 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received unexpected event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 for instance with vm_state building and task_state spawning.
Nov 27 03:18:46 user nova-compute[75006]: INFO nova.compute.manager [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Took 17.69 seconds to build instance.
Nov 27 03:18:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-83c37812-02a0-4b76-acea-18f8d18e877d tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "503a960f-c3f6-4b8f-af89-7796916be32c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.841s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:18:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Updating instance_info_cache with network_info: [{"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:18:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:18:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:48 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:18:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:18:49 user nova-compute[75006]: INFO nova.compute.claims [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Claim successful on node user
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:18:49 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:18:49 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:18:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:18:50 user nova-compute[75006]: INFO nova.virt.block_device [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Booting with volume a3e59352-8327-49e8-97c2-18693825c2ed at /dev/vda
Nov 27 03:18:50 user nova-compute[75006]: DEBUG nova.policy [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5eaefb35723c4150b9cf83de7aec498c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b657ee609745b6992fa114bc8f2308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG os_brick.utils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98c2dc5-3b16-4d4c-88dd-dc4530152250]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50c7ef1-9935-443a-9375-0b59585d44b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[11614653-0734-4813-86c9-ccc526fc6840]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3576a5e-4528-4764-82c8-8bb023f70e58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:18:50 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:18:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e52acf-005a-4c69-9b84-927bb323eb41]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG os_brick.utils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating existing volume attachment record: 0e4356b5-cbc6-4548-8817-27870d390cb1 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:18:50 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully created port: 7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:51 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully created port: e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:52 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully created port: ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:54 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully created port: 78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:54 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully created port: ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully updated port: 7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-11b73aea-e4b9-4ae9-bf44-2aadbd702744 req-3958a2f0-d4c7-4266-9153-4c37a7401e7d service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-changed-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-11b73aea-e4b9-4ae9-bf44-2aadbd702744 req-3958a2f0-d4c7-4266-9153-4c37a7401e7d service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing instance network info cache due to event network-changed-7c0690b6-99ad-420f-a371-9463c3d9e2c5. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-11b73aea-e4b9-4ae9-bf44-2aadbd702744 req-3958a2f0-d4c7-4266-9153-4c37a7401e7d service nova] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-11b73aea-e4b9-4ae9-bf44-2aadbd702744 req-3958a2f0-d4c7-4266-9153-4c37a7401e7d service nova] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-11b73aea-e4b9-4ae9-bf44-2aadbd702744 req-3958a2f0-d4c7-4266-9153-4c37a7401e7d service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing network info cache for port 7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-11b73aea-e4b9-4ae9-bf44-2aadbd702744 req-3958a2f0-d4c7-4266-9153-4c37a7401e7d service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "5956b54a-82d6-44f4-95f6-e92408ea924d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-11b73aea-e4b9-4ae9-bf44-2aadbd702744 req-3958a2f0-d4c7-4266-9153-4c37a7401e7d service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-11b73aea-e4b9-4ae9-bf44-2aadbd702744 req-3958a2f0-d4c7-4266-9153-4c37a7401e7d service nova] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:18:55 user nova-compute[75006]: INFO nova.compute.claims [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Claim successful on node user
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully updated port: 37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:18:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.policy [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06346aa70a26471084876444d2f6b053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1e458a5b9b461bbdba0924d0cc6750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:18:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Creating image(s)
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "/opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "/opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "/opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.234s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully updated port: 08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk 1073741824" returned: 0 in 0.058s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Successfully created port: 5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-changed-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing instance network info cache due to event network-changed-37d5162f-6cf7-47a6-8d10-98d4a63b0706. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing network info cache for port 37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Cannot resize image /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Ensure instance console log exists: /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:18:57 user nova-compute[75006]: INFO nova.virt.block_device [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Booting with volume 23e29086-9d43-40b7-9b2a-495ed269eb5a at /dev/vdb
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-changed-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing instance network info cache due to event network-changed-08fd5394-cd17-4456-a310-e65e34282584. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing network info cache for port 08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG os_brick.utils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd659202-4b4a-4886-b4a8-a1bd4f9f839d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[82613411-1d0b-4257-b477-c67216a37577]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[af529c01-d312-46f1-b067-8e525cebb10d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3414eb-737a-4ec8-b4a4-0d66eb32b277]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully updated port: e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:18:57 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:18:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1695d14-d3bd-477b-934b-a641cca59bfb]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG os_brick.utils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating existing volume attachment record: bf6c65f2-8222-491c-8053-21543196b960 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:18:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Successfully updated port: 5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "refresh_cache-5956b54a-82d6-44f4-95f6-e92408ea924d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquired lock "refresh_cache-5956b54a-82d6-44f4-95f6-e92408ea924d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-3531a4f5-3d10-4c98-ab52-e2b8282f68ae req-703ac6c8-6aaa-46c5-872a-e22caf6fc5fe service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received event network-changed-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-3531a4f5-3d10-4c98-ab52-e2b8282f68ae req-703ac6c8-6aaa-46c5-872a-e22caf6fc5fe service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Refreshing instance network info cache due to event network-changed-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3531a4f5-3d10-4c98-ab52-e2b8282f68ae req-703ac6c8-6aaa-46c5-872a-e22caf6fc5fe service nova] Acquiring lock "refresh_cache-5956b54a-82d6-44f4-95f6-e92408ea924d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2fb52f0-8b58-4b1f-80e2-46c5e2947688 req-7ca71165-6bdc-4621-ae5d-0d0046ec628a service nova] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Updating instance_info_cache with network_info: [{"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Releasing lock "refresh_cache-5956b54a-82d6-44f4-95f6-e92408ea924d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Instance network_info: |[{"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3531a4f5-3d10-4c98-ab52-e2b8282f68ae req-703ac6c8-6aaa-46c5-872a-e22caf6fc5fe service nova] Acquired lock "refresh_cache-5956b54a-82d6-44f4-95f6-e92408ea924d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-3531a4f5-3d10-4c98-ab52-e2b8282f68ae req-703ac6c8-6aaa-46c5-872a-e22caf6fc5fe service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Refreshing network info cache for port 5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Start _get_guest_xml network_info=[{"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:18:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-754625581',display_name='tempest-VolumesActionsTest-instance-754625581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-754625581',id=12,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f1e458a5b9b461bbdba0924d0cc6750',ramdisk_id='',reservation_id='r-rfxnl23r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1256624352',owner_user_name='tempest-VolumesActionsTest-1256624352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:57Z,user_data=None,user_id='06346aa70a26471084876444d2f6b053',uuid=5956b54a-82d6-44f4-95f6-e92408ea924d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Converting VIF {"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:d4,bridge_name='br-int',has_traffic_filtering=True,id=5ddbccec-7ebb-442f-a27c-3ed76e9a24e9,network=Network(33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddbccec-7e') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lazy-loading 'pci_devices' on Instance uuid 5956b54a-82d6-44f4-95f6-e92408ea924d {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:18:58 user nova-compute[75006]:   <uuid>5956b54a-82d6-44f4-95f6-e92408ea924d</uuid>
Nov 27 03:18:58 user nova-compute[75006]:   <name>instance-0000000c</name>
Nov 27 03:18:58 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:18:58 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:18:58 user nova-compute[75006]:   <metadata>
Nov 27 03:18:58 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:18:58 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:18:58 user nova-compute[75006]:       <nova:name>tempest-VolumesActionsTest-instance-754625581</nova:name>
Nov 27 03:18:58 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:18:58</nova:creationTime>
Nov 27 03:18:58 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:18:58 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:18:58 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:18:58 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:18:58 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:18:58 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:18:58 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:18:58 user nova-compute[75006]:       <nova:owner>
Nov 27 03:18:58 user nova-compute[75006]:         <nova:user uuid="06346aa70a26471084876444d2f6b053">tempest-VolumesActionsTest-1256624352-project-member</nova:user>
Nov 27 03:18:58 user nova-compute[75006]:         <nova:project uuid="8f1e458a5b9b461bbdba0924d0cc6750">tempest-VolumesActionsTest-1256624352</nova:project>
Nov 27 03:18:58 user nova-compute[75006]:       </nova:owner>
Nov 27 03:18:58 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:18:58 user nova-compute[75006]:       <nova:ports>
Nov 27 03:18:58 user nova-compute[75006]:         <nova:port uuid="5ddbccec-7ebb-442f-a27c-3ed76e9a24e9">
Nov 27 03:18:58 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:18:58 user nova-compute[75006]:         </nova:port>
Nov 27 03:18:58 user nova-compute[75006]:       </nova:ports>
Nov 27 03:18:58 user nova-compute[75006]:     </nova:instance>
Nov 27 03:18:58 user nova-compute[75006]:   </metadata>
Nov 27 03:18:58 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:18:58 user nova-compute[75006]:     <system>
Nov 27 03:18:58 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:18:58 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:18:58 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:18:58 user nova-compute[75006]:       <entry name="serial">5956b54a-82d6-44f4-95f6-e92408ea924d</entry>
Nov 27 03:18:58 user nova-compute[75006]:       <entry name="uuid">5956b54a-82d6-44f4-95f6-e92408ea924d</entry>
Nov 27 03:18:58 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:18:58 user nova-compute[75006]:     </system>
Nov 27 03:18:58 user nova-compute[75006]:   </sysinfo>
Nov 27 03:18:58 user nova-compute[75006]:   <os>
Nov 27 03:18:58 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:18:58 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:18:58 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:18:58 user nova-compute[75006]:   </os>
Nov 27 03:18:58 user nova-compute[75006]:   <features>
Nov 27 03:18:58 user nova-compute[75006]:     <acpi/>
Nov 27 03:18:58 user nova-compute[75006]:     <apic/>
Nov 27 03:18:58 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:18:58 user nova-compute[75006]:   </features>
Nov 27 03:18:58 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:18:58 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:18:58 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:18:58 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:18:58 user nova-compute[75006]:   </clock>
Nov 27 03:18:58 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:18:58 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:18:58 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:18:58 user nova-compute[75006]:   </cpu>
Nov 27 03:18:58 user nova-compute[75006]:   <devices>
Nov 27 03:18:58 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:18:58 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:18:58 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk"/>
Nov 27 03:18:58 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:18:58 user nova-compute[75006]:     </disk>
Nov 27 03:18:58 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:18:58 user nova-compute[75006]:       <mac address="fa:16:3e:ef:86:d4"/>
Nov 27 03:18:58 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:58 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:18:58 user nova-compute[75006]:       <target dev="tap5ddbccec-7e"/>
Nov 27 03:18:58 user nova-compute[75006]:     </interface>
Nov 27 03:18:58 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:18:58 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/console.log" append="off"/>
Nov 27 03:18:58 user nova-compute[75006]:     </serial>
Nov 27 03:18:58 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:18:58 user nova-compute[75006]:     <video>
Nov 27 03:18:58 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:18:58 user nova-compute[75006]:     </video>
Nov 27 03:18:58 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:18:58 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:18:58 user nova-compute[75006]:     </rng>
Nov 27 03:18:58 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:18:58 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:18:58 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:18:58 user nova-compute[75006]:     </memballoon>
Nov 27 03:18:58 user nova-compute[75006]:   </devices>
Nov 27 03:18:58 user nova-compute[75006]: </domain>
Nov 27 03:18:58 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-754625581',display_name='tempest-VolumesActionsTest-instance-754625581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-754625581',id=12,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f1e458a5b9b461bbdba0924d0cc6750',ramdisk_id='',reservation_id='r-rfxnl23r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1256624352',owner_user_name='tempest-VolumesActionsTest-1256624352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:57Z,user_data=None,user_id='06346aa70a26471084876444d2f6b053',uuid=5956b54a-82d6-44f4-95f6-e92408ea924d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Converting VIF {"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:d4,bridge_name='br-int',has_traffic_filtering=True,id=5ddbccec-7ebb-442f-a27c-3ed76e9a24e9,network=Network(33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddbccec-7e') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG os_vif [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:d4,bridge_name='br-int',has_traffic_filtering=True,id=5ddbccec-7ebb-442f-a27c-3ed76e9a24e9,network=Network(33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddbccec-7e') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65b53caa-2816-5583-978b-8e72819c82ee', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ddbccec-7e, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ddbccec-7e, col_values=(('qos', UUID('b6610f61-9dc6-4b74-99cf-4027a1ea9998')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ddbccec-7e, col_values=(('external_ids', {'iface-id': '5ddbccec-7ebb-442f-a27c-3ed76e9a24e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:86:d4', 'vm-uuid': '5956b54a-82d6-44f4-95f6-e92408ea924d'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:58 user nova-compute[75006]: INFO os_vif [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:d4,bridge_name='br-int',has_traffic_filtering=True,id=5ddbccec-7ebb-442f-a27c-3ed76e9a24e9,network=Network(33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddbccec-7e')
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully updated port: ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] No VIF found with MAC fa:16:3e:ef:86:d4, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-3531a4f5-3d10-4c98-ab52-e2b8282f68ae req-703ac6c8-6aaa-46c5-872a-e22caf6fc5fe service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Updated VIF entry in instance network info cache for port 5ddbccec-7ebb-442f-a27c-3ed76e9a24e9. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-3531a4f5-3d10-4c98-ab52-e2b8282f68ae req-703ac6c8-6aaa-46c5-872a-e22caf6fc5fe service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Updating instance_info_cache with network_info: [{"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3531a4f5-3d10-4c98-ab52-e2b8282f68ae req-703ac6c8-6aaa-46c5-872a-e22caf6fc5fe service nova] Releasing lock "refresh_cache-5956b54a-82d6-44f4-95f6-e92408ea924d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully updated port: 78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-changed-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing instance network info cache due to event network-changed-e5134743-9a4e-4508-8ff2-9fb481463a8a. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing network info cache for port e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-changed-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing instance network info cache due to event network-changed-ef72d3cb-a396-4554-b801-ddfc0c017b66. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing network info cache for port ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Successfully updated port: ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:18:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-changed-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing instance network info cache due to event network-changed-78edd02e-d9e2-42f0-874b-ccec70162773. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing network info cache for port 78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.network.neutron [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-e86e87b0-ef19-4535-adbb-55d53af3a214 req-1bcdf242-1833-48f8-9e66-19886b48c6a7 service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received event network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e86e87b0-ef19-4535-adbb-55d53af3a214 req-1bcdf242-1833-48f8-9e66-19886b48c6a7 service nova] Acquiring lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e86e87b0-ef19-4535-adbb-55d53af3a214 req-1bcdf242-1833-48f8-9e66-19886b48c6a7 service nova] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e86e87b0-ef19-4535-adbb-55d53af3a214 req-1bcdf242-1833-48f8-9e66-19886b48c6a7 service nova] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-e86e87b0-ef19-4535-adbb-55d53af3a214 req-1bcdf242-1833-48f8-9e66-19886b48c6a7 service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] No waiting events found dispatching network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:00 user nova-compute[75006]: WARNING nova.compute.manager [req-e86e87b0-ef19-4535-adbb-55d53af3a214 req-1bcdf242-1833-48f8-9e66-19886b48c6a7 service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received unexpected event network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 for instance with vm_state building and task_state spawning.
Nov 27 03:19:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4303cd5d-5f7e-4673-a424-5f5b04444e95 req-7032db6f-74c7-41dc-aa5b-8a19d0f2ea61 service nova] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-c5814735-9f86-432e-9d21-65d8775eab79 req-db492197-ce62-40d0-a0cd-2410994c0f04 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-changed-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-c5814735-9f86-432e-9d21-65d8775eab79 req-db492197-ce62-40d0-a0cd-2410994c0f04 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing instance network info cache due to event network-changed-ec378bc7-8992-4738-a489-c805120ae864. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:19:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5814735-9f86-432e-9d21-65d8775eab79 req-db492197-ce62-40d0-a0cd-2410994c0f04 service nova] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:19:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Instance spawned successfully.
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:02 user nova-compute[75006]: INFO nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-0e2d6d17-2ed6-4faa-bb4f-cae486587c9b req-06364b3a-6175-474f-a58a-5e78d70b4ced service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received event network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0e2d6d17-2ed6-4faa-bb4f-cae486587c9b req-06364b3a-6175-474f-a58a-5e78d70b4ced service nova] Acquiring lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0e2d6d17-2ed6-4faa-bb4f-cae486587c9b req-06364b3a-6175-474f-a58a-5e78d70b4ced service nova] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0e2d6d17-2ed6-4faa-bb4f-cae486587c9b req-06364b3a-6175-474f-a58a-5e78d70b4ced service nova] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-0e2d6d17-2ed6-4faa-bb4f-cae486587c9b req-06364b3a-6175-474f-a58a-5e78d70b4ced service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] No waiting events found dispatching network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:02 user nova-compute[75006]: WARNING nova.compute.manager [req-0e2d6d17-2ed6-4faa-bb4f-cae486587c9b req-06364b3a-6175-474f-a58a-5e78d70b4ced service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received unexpected event network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 for instance with vm_state building and task_state spawning.
Nov 27 03:19:02 user nova-compute[75006]: INFO nova.compute.manager [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Took 7.04 seconds to build instance.
Nov 27 03:19:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8919282-877e-4d0b-9c9e-9ed258802101 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.150s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [{"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance network_info: |[{"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5814735-9f86-432e-9d21-65d8775eab79 req-db492197-ce62-40d0-a0cd-2410994c0f04 service nova] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:02 user nova-compute[75006]: DEBUG nova.network.neutron [req-c5814735-9f86-432e-9d21-65d8775eab79 req-db492197-ce62-40d0-a0cd-2410994c0f04 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing network info cache for port ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:19:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-c5814735-9f86-432e-9d21-65d8775eab79 req-db492197-ce62-40d0-a0cd-2410994c0f04 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updated VIF entry in instance network info cache for port ec378bc7-8992-4738-a489-c805120ae864. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:19:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-c5814735-9f86-432e-9d21-65d8775eab79 req-db492197-ce62-40d0-a0cd-2410994c0f04 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [{"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5814735-9f86-432e-9d21-65d8775eab79 req-db492197-ce62-40d0-a0cd-2410994c0f04 service nova] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:04 user nova-compute[75006]: INFO nova.virt.block_device [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Booting with volume 6eada81f-afaf-4f21-8e66-e2c5984408e0 at /dev/vdc
Nov 27 03:19:04 user nova-compute[75006]: DEBUG os_brick.utils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3737de-c21c-431a-80c4-03649d28774d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9092698a-c788-42df-a1de-8afef9785892]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9fcae5-c136-4258-8ee5-9b1f25d01205]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[976bbbec-c94b-4d62-8f23-ad23d98cdd4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:04 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:19:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceba3b26-e559-46f4-8979-0963ccbb4582]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG os_brick.utils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:04 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating existing volume attachment record: 70efd14d-526e-4d08-8128-228585db850b {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:19:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:19:11 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Creating image(s)
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Ensure instance console log exists: /opt/stack/data/nova/instances/fc95fb16-d2f5-4f45-ac78-bcd060f585a8/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Start _get_guest_xml network_info=[{"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '0e4356b5-cbc6-4548-8817-27870d390cb1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgeuCYEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3e59352-8327-49e8-97c2-18693825c2ed', 'serial': 'a3e59352-8327-49e8-97c2-18693825c2ed'}, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'bf6c65f2-8222-491c-8053-21543196b960', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnwaRPuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8', 'attached_at': '', 'detached_at': '', 'volume_id': '23e29086-9d43-40b7-9b2a-495ed269eb5a', 'serial': '23e29086-9d43-40b7-9b2a-495ed269eb5a'}, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '70efd14d-526e-4d08-8128-228585db850b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWSBGhst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8', 'attached_at': '', 'detached_at': '', 'volume_id': '6eada81f-afaf-4f21-8e66-e2c5984408e0', 'serial': '6eada81f-afaf-4f21-8e66-e2c5984408e0'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:19:11 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:19:11 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgeuCYEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:11 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:11 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:11 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89f0d0-3987-4bf6-b508-3722c2e4cf12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:19:11 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b90da6c-6fb7-46b6-ad27-fbcf843aa9bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed] added
Nov 27 03:19:11 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ba21b9-c205-475f-987c-cf1e4e4fe9c6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7397cc5-331e-4af2-bc72-5ba8c44921dd]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgeuCYEA {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgeuCYEA" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[352e8356-56de-486a-ae22-85cc5df43a98]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HgeuCYEA'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdb4b89-c463-465b-b646-e58d9d86e84a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c12f132-92e1-4469-893b-e04ab9af7a23]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:11 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:11 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7834f512-bb57-4679-85af-95da03377847]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed, portal: 172.16.0.220,3260]
Nov 27 03:19:11 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed, portal: 172.16.0.220,3260] successful.
Nov 27 03:19:11 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a260cd9-e2c6-4bf1-9b9b-559413ec2fd5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[749fe490-977b-4beb-8c10-47eb3474cf8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:11 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:11 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:11 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:11 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[591b01a1-0b1d-40f7-bf5c-9e7bea4c5e3c]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:19:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgeuCYEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26630633066613861', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630633066613861', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnwaRPuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:12 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:12 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:12 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9f4c85-ca40-42f6-9dc5-8dcc6d14bfab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:19:12 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8543ea-17a8-4685-8a72-bddb0db72bb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a] added
Nov 27 03:19:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fba439-4855-45dc-882f-e7df1cc99608]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ca6f1f-099a-4675-8e20-322e6d2355d8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnwaRPuv {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnwaRPuv" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06ef8ff-cf33-49a2-a864-1835c028287d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CnwaRPuv'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a2312a-0c6e-478a-9b06-d9c5aa049d55]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb06111-00ee-4094-b03d-81a97cb29937]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:12 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:12 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2548cc1f-8efa-4bd1-9ea6-869fe40fba69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a, portal: 172.16.0.220,3260]
Nov 27 03:19:12 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a, portal: 172.16.0.220,3260] successful.
Nov 27 03:19:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c782f1-5f86-4736-a2ea-6fc85f11e6a9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15f098a-de5c-401c-ad39-48294f1a3bb5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:12 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:12 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:12 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:12 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409c77d-2080-4d41-9900-2a5d6dbb2ea7]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:19:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnwaRPuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26532346566393734', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532346566393734', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWSBGhst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:13 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:13 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:13 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:19:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5451ca24-3bd1-459a-a721-8cd4706f16ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:19:13 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3398d6a8-60aa-4e77-8168-0d8bcc135c6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0] added
Nov 27 03:19:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad36758-fe58-4ea4-9ec3-fb71f8ce76bb]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[780f071c-1b10-402f-acc7-f280d1066780]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jWSBGhst {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jWSBGhst" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b454efe-fd32-4c02-8020-e9140b2dbec3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jWSBGhst'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a623d467-45df-4c61-87c2-568fb5836678]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[058666a8-ec6b-4c58-96ac-4975fc9a534e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.199s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ecd1c5-e41b-4e52-b298-c46b23431382]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0, portal: 172.16.0.220,3260]
Nov 27 03:19:14 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0, portal: 172.16.0.220,3260] successful.
Nov 27 03:19:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd3dda6-f3a0-4332-bc25-2fbad4268c83]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809da14-5109-4fd1-ad83-127fbb2eb610]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:14 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa745b2-2327-4d72-9c10-5cf5a0362888]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:19:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWSBGhst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23962393865313830', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962393865313830', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d7:af,bridge_name='br-int',has_traffic_filtering=True,id=7c0690b6-99ad-420f-a371-9463c3d9e2c5,network=Network(6be19388-221e-4a81-a5b5-c5b1c235bb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0690b6-99') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:76:f0,bridge_name='br-int',has_traffic_filtering=True,id=37d5162f-6cf7-47a6-8d10-98d4a63b0706,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37d5162f-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:16:9d,bridge_name='br-int',has_traffic_filtering=True,id=08fd5394-cd17-4456-a310-e65e34282584,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08fd5394-cd') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=e5134743-9a4e-4508-8ff2-9fb481463a8a,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5134743-9a') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:13:91,bridge_name='br-int',has_traffic_filtering=True,id=ef72d3cb-a396-4554-b801-ddfc0c017b66,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef72d3cb-a3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9b:be,bridge_name='br-int',has_traffic_filtering=True,id=78edd02e-d9e2-42f0-874b-ccec70162773,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78edd02e-d9') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=ec378bc7-8992-4738-a489-c805120ae864,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec378bc7-89') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.objects.instance [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lazy-loading 'pci_devices' on Instance uuid fc95fb16-d2f5-4f45-ac78-bcd060f585a8 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:19:15 user nova-compute[75006]:   <uuid>fc95fb16-d2f5-4f45-ac78-bcd060f585a8</uuid>
Nov 27 03:19:15 user nova-compute[75006]:   <name>instance-0000000b</name>
Nov 27 03:19:15 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:19:15 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:19:15 user nova-compute[75006]:   <metadata>
Nov 27 03:19:15 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:19:15 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:19:15 user nova-compute[75006]:       <nova:name>tempest-device-tagging-server-1756560931</nova:name>
Nov 27 03:19:15 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:19:11</nova:creationTime>
Nov 27 03:19:15 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:19:15 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:19:15 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:19:15 user nova-compute[75006]:       <nova:owner>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:user uuid="5eaefb35723c4150b9cf83de7aec498c">tempest-TaggedBootDevicesTest_v242-383429421-project-member</nova:user>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:project uuid="88b657ee609745b6992fa114bc8f2308">tempest-TaggedBootDevicesTest_v242-383429421</nova:project>
Nov 27 03:19:15 user nova-compute[75006]:       </nova:owner>
Nov 27 03:19:15 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:19:15 user nova-compute[75006]:       <nova:ports>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:port uuid="7c0690b6-99ad-420f-a371-9463c3d9e2c5">
Nov 27 03:19:15 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 03:19:15 user nova-compute[75006]:         </nova:port>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:port uuid="37d5162f-6cf7-47a6-8d10-98d4a63b0706">
Nov 27 03:19:15 user nova-compute[75006]:           <nova:ip type="fixed" address="10.1.1.151" ipVersion="4"/>
Nov 27 03:19:15 user nova-compute[75006]:         </nova:port>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:port uuid="08fd5394-cd17-4456-a310-e65e34282584">
Nov 27 03:19:15 user nova-compute[75006]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Nov 27 03:19:15 user nova-compute[75006]:         </nova:port>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:port uuid="e5134743-9a4e-4508-8ff2-9fb481463a8a">
Nov 27 03:19:15 user nova-compute[75006]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Nov 27 03:19:15 user nova-compute[75006]:         </nova:port>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:port uuid="ef72d3cb-a396-4554-b801-ddfc0c017b66">
Nov 27 03:19:15 user nova-compute[75006]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Nov 27 03:19:15 user nova-compute[75006]:         </nova:port>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:port uuid="78edd02e-d9e2-42f0-874b-ccec70162773">
Nov 27 03:19:15 user nova-compute[75006]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 27 03:19:15 user nova-compute[75006]:         </nova:port>
Nov 27 03:19:15 user nova-compute[75006]:         <nova:port uuid="ec378bc7-8992-4738-a489-c805120ae864">
Nov 27 03:19:15 user nova-compute[75006]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 27 03:19:15 user nova-compute[75006]:         </nova:port>
Nov 27 03:19:15 user nova-compute[75006]:       </nova:ports>
Nov 27 03:19:15 user nova-compute[75006]:     </nova:instance>
Nov 27 03:19:15 user nova-compute[75006]:   </metadata>
Nov 27 03:19:15 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:19:15 user nova-compute[75006]:     <system>
Nov 27 03:19:15 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:19:15 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:19:15 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:19:15 user nova-compute[75006]:       <entry name="serial">fc95fb16-d2f5-4f45-ac78-bcd060f585a8</entry>
Nov 27 03:19:15 user nova-compute[75006]:       <entry name="uuid">fc95fb16-d2f5-4f45-ac78-bcd060f585a8</entry>
Nov 27 03:19:15 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:19:15 user nova-compute[75006]:     </system>
Nov 27 03:19:15 user nova-compute[75006]:   </sysinfo>
Nov 27 03:19:15 user nova-compute[75006]:   <os>
Nov 27 03:19:15 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:19:15 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:19:15 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:19:15 user nova-compute[75006]:   </os>
Nov 27 03:19:15 user nova-compute[75006]:   <features>
Nov 27 03:19:15 user nova-compute[75006]:     <acpi/>
Nov 27 03:19:15 user nova-compute[75006]:     <apic/>
Nov 27 03:19:15 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:19:15 user nova-compute[75006]:   </features>
Nov 27 03:19:15 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:19:15 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:19:15 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:19:15 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:19:15 user nova-compute[75006]:   </clock>
Nov 27 03:19:15 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:19:15 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:19:15 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:19:15 user nova-compute[75006]:   </cpu>
Nov 27 03:19:15 user nova-compute[75006]:   <devices>
Nov 27 03:19:15 user nova-compute[75006]:     <disk type="file" device="cdrom">
Nov 27 03:19:15 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 03:19:15 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/fc95fb16-d2f5-4f45-ac78-bcd060f585a8/disk.config"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="hda" bus="ide"/>
Nov 27 03:19:15 user nova-compute[75006]:     </disk>
Nov 27 03:19:15 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:19:15 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:19:15 user nova-compute[75006]:       <source dev="/dev/sdc"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <serial>a3e59352-8327-49e8-97c2-18693825c2ed</serial>
Nov 27 03:19:15 user nova-compute[75006]:     </disk>
Nov 27 03:19:15 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:19:15 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:19:15 user nova-compute[75006]:       <source dev="/dev/sdd"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <serial>23e29086-9d43-40b7-9b2a-495ed269eb5a</serial>
Nov 27 03:19:15 user nova-compute[75006]:     </disk>
Nov 27 03:19:15 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:19:15 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:19:15 user nova-compute[75006]:       <source dev="/dev/sde"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="vdc" bus="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <serial>6eada81f-afaf-4f21-8e66-e2c5984408e0</serial>
Nov 27 03:19:15 user nova-compute[75006]:     </disk>
Nov 27 03:19:15 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:19:15 user nova-compute[75006]:       <mac address="fa:16:3e:b6:d7:af"/>
Nov 27 03:19:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="tap7c0690b6-99"/>
Nov 27 03:19:15 user nova-compute[75006]:     </interface>
Nov 27 03:19:15 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:19:15 user nova-compute[75006]:       <mac address="fa:16:3e:ec:76:f0"/>
Nov 27 03:19:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="tap37d5162f-6c"/>
Nov 27 03:19:15 user nova-compute[75006]:     </interface>
Nov 27 03:19:15 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:19:15 user nova-compute[75006]:       <mac address="fa:16:3e:79:16:9d"/>
Nov 27 03:19:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="tap08fd5394-cd"/>
Nov 27 03:19:15 user nova-compute[75006]:     </interface>
Nov 27 03:19:15 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:19:15 user nova-compute[75006]:       <mac address="fa:16:3e:56:07:4f"/>
Nov 27 03:19:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="tape5134743-9a"/>
Nov 27 03:19:15 user nova-compute[75006]:     </interface>
Nov 27 03:19:15 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:19:15 user nova-compute[75006]:       <mac address="fa:16:3e:d7:13:91"/>
Nov 27 03:19:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="tapef72d3cb-a3"/>
Nov 27 03:19:15 user nova-compute[75006]:     </interface>
Nov 27 03:19:15 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:19:15 user nova-compute[75006]:       <mac address="fa:16:3e:f3:9b:be"/>
Nov 27 03:19:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="tap78edd02e-d9"/>
Nov 27 03:19:15 user nova-compute[75006]:     </interface>
Nov 27 03:19:15 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:19:15 user nova-compute[75006]:       <mac address="fa:16:3e:9c:bd:d4"/>
Nov 27 03:19:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:19:15 user nova-compute[75006]:       <target dev="tapec378bc7-89"/>
Nov 27 03:19:15 user nova-compute[75006]:     </interface>
Nov 27 03:19:15 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:19:15 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/fc95fb16-d2f5-4f45-ac78-bcd060f585a8/console.log" append="off"/>
Nov 27 03:19:15 user nova-compute[75006]:     </serial>
Nov 27 03:19:15 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:19:15 user nova-compute[75006]:     <video>
Nov 27 03:19:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:15 user nova-compute[75006]:     </video>
Nov 27 03:19:15 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:19:15 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:19:15 user nova-compute[75006]:     </rng>
Nov 27 03:19:15 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:19:15 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:19:15 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:19:15 user nova-compute[75006]:     </memballoon>
Nov 27 03:19:15 user nova-compute[75006]:   </devices>
Nov 27 03:19:15 user nova-compute[75006]: </domain>
Nov 27 03:19:15 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d7:af,bridge_name='br-int',has_traffic_filtering=True,id=7c0690b6-99ad-420f-a371-9463c3d9e2c5,network=Network(6be19388-221e-4a81-a5b5-c5b1c235bb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0690b6-99') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d7:af,bridge_name='br-int',has_traffic_filtering=True,id=7c0690b6-99ad-420f-a371-9463c3d9e2c5,network=Network(6be19388-221e-4a81-a5b5-c5b1c235bb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0690b6-99') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5438233-d3bd-5936-b539-6b5fe11dddb3', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c0690b6-99, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c0690b6-99, col_values=(('qos', UUID('8c9e6848-ccbe-441c-a941-2c8ca4d49685')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c0690b6-99, col_values=(('external_ids', {'iface-id': '7c0690b6-99ad-420f-a371-9463c3d9e2c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:d7:af', 'vm-uuid': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: INFO os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:d7:af,bridge_name='br-int',has_traffic_filtering=True,id=7c0690b6-99ad-420f-a371-9463c3d9e2c5,network=Network(6be19388-221e-4a81-a5b5-c5b1c235bb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0690b6-99')
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:76:f0,bridge_name='br-int',has_traffic_filtering=True,id=37d5162f-6cf7-47a6-8d10-98d4a63b0706,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37d5162f-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:76:f0,bridge_name='br-int',has_traffic_filtering=True,id=37d5162f-6cf7-47a6-8d10-98d4a63b0706,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37d5162f-6c') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d2c356f-706a-57e3-a101-d42a22556e50', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37d5162f-6c, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37d5162f-6c, col_values=(('qos', UUID('2078396d-0998-464c-a6c2-6cb37e695671')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37d5162f-6c, col_values=(('external_ids', {'iface-id': '37d5162f-6cf7-47a6-8d10-98d4a63b0706', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:76:f0', 'vm-uuid': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: INFO os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:76:f0,bridge_name='br-int',has_traffic_filtering=True,id=37d5162f-6cf7-47a6-8d10-98d4a63b0706,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37d5162f-6c')
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:16:9d,bridge_name='br-int',has_traffic_filtering=True,id=08fd5394-cd17-4456-a310-e65e34282584,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08fd5394-cd') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:16:9d,bridge_name='br-int',has_traffic_filtering=True,id=08fd5394-cd17-4456-a310-e65e34282584,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08fd5394-cd') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddaf3218-f381-5ecb-8e14-b2b276151254', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08fd5394-cd, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08fd5394-cd, col_values=(('qos', UUID('e14ab740-02ee-4f48-af37-07a8632236e5')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08fd5394-cd, col_values=(('external_ids', {'iface-id': '08fd5394-cd17-4456-a310-e65e34282584', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:16:9d', 'vm-uuid': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: INFO os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:16:9d,bridge_name='br-int',has_traffic_filtering=True,id=08fd5394-cd17-4456-a310-e65e34282584,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08fd5394-cd')
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=e5134743-9a4e-4508-8ff2-9fb481463a8a,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5134743-9a') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=e5134743-9a4e-4508-8ff2-9fb481463a8a,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5134743-9a') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7381c96-40d8-50a0-8883-0031a45a926b', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5134743-9a, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5134743-9a, col_values=(('qos', UUID('e046f926-328c-4ef7-a6fd-c247f6c684df')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5134743-9a, col_values=(('external_ids', {'iface-id': 'e5134743-9a4e-4508-8ff2-9fb481463a8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:07:4f', 'vm-uuid': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: INFO os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=e5134743-9a4e-4508-8ff2-9fb481463a8a,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5134743-9a')
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:13:91,bridge_name='br-int',has_traffic_filtering=True,id=ef72d3cb-a396-4554-b801-ddfc0c017b66,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef72d3cb-a3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:13:91,bridge_name='br-int',has_traffic_filtering=True,id=ef72d3cb-a396-4554-b801-ddfc0c017b66,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef72d3cb-a3') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37f4807c-ec98-5782-92fb-ecce8968fcc4', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef72d3cb-a3, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef72d3cb-a3, col_values=(('qos', UUID('d8adcb9c-8b91-4cdb-b5a6-ad8a2538a311')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef72d3cb-a3, col_values=(('external_ids', {'iface-id': 'ef72d3cb-a396-4554-b801-ddfc0c017b66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:13:91', 'vm-uuid': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: INFO os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:13:91,bridge_name='br-int',has_traffic_filtering=True,id=ef72d3cb-a396-4554-b801-ddfc0c017b66,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef72d3cb-a3')
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9b:be,bridge_name='br-int',has_traffic_filtering=True,id=78edd02e-d9e2-42f0-874b-ccec70162773,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78edd02e-d9') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9b:be,bridge_name='br-int',has_traffic_filtering=True,id=78edd02e-d9e2-42f0-874b-ccec70162773,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78edd02e-d9') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a02c1645-f405-5013-b5c4-60f859194056', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78edd02e-d9, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78edd02e-d9, col_values=(('qos', UUID('e3ceae9f-e3f8-4673-b4d2-1ea143d13425')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78edd02e-d9, col_values=(('external_ids', {'iface-id': '78edd02e-d9e2-42f0-874b-ccec70162773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:9b:be', 'vm-uuid': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: INFO os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9b:be,bridge_name='br-int',has_traffic_filtering=True,id=78edd02e-d9e2-42f0-874b-ccec70162773,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78edd02e-d9')
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:18:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=ec378bc7-8992-4738-a489-c805120ae864,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec378bc7-89') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=ec378bc7-8992-4738-a489-c805120ae864,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec378bc7-89') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39a7ce6a-c2cb-5503-9fda-fa20569ab5e8', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec378bc7-89, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec378bc7-89, col_values=(('qos', UUID('f8f6f5d7-01ef-49b3-9d96-117a9f94c321')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec378bc7-89, col_values=(('external_ids', {'iface-id': 'ec378bc7-8992-4738-a489-c805120ae864', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:bd:d4', 'vm-uuid': 'fc95fb16-d2f5-4f45-ac78-bcd060f585a8'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:16 user nova-compute[75006]: INFO os_vif [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=ec378bc7-8992-4738-a489-c805120ae864,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec378bc7-89')
Nov 27 03:19:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] No BDM found with device name hda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] No VIF found with MAC fa:16:3e:b6:d7:af, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] No VIF found with MAC fa:16:3e:d7:13:91, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:19:16 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Using config drive
Nov 27 03:19:16 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Creating config drive at /opt/stack/data/nova/instances/fc95fb16-d2f5-4f45-ac78-bcd060f585a8/disk.config
Nov 27 03:19:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc95fb16-d2f5-4f45-ac78-bcd060f585a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpke5k09n1 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc95fb16-d2f5-4f45-ac78-bcd060f585a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpke5k09n1" returned: 0 in 0.069s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-3c8f6668-bbfc-4877-9563-048d1ca5343c req-f29286e0-a5c8-42db-9199-075a71726a4a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3c8f6668-bbfc-4877-9563-048d1ca5343c req-f29286e0-a5c8-42db-9199-075a71726a4a service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3c8f6668-bbfc-4877-9563-048d1ca5343c req-f29286e0-a5c8-42db-9199-075a71726a4a service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3c8f6668-bbfc-4877-9563-048d1ca5343c req-f29286e0-a5c8-42db-9199-075a71726a4a service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-3c8f6668-bbfc-4877-9563-048d1ca5343c req-f29286e0-a5c8-42db-9199-075a71726a4a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:18 user nova-compute[75006]: WARNING nova.compute.manager [req-3c8f6668-bbfc-4877-9563-048d1ca5343c req-f29286e0-a5c8-42db-9199-075a71726a4a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 for instance with vm_state building and task_state spawning.
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-9a2f7814-daf6-482c-8011-8dd45803dfeb req-20861d95-512e-4f77-81f8-4735800a0289 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9a2f7814-daf6-482c-8011-8dd45803dfeb req-20861d95-512e-4f77-81f8-4735800a0289 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9a2f7814-daf6-482c-8011-8dd45803dfeb req-20861d95-512e-4f77-81f8-4735800a0289 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9a2f7814-daf6-482c-8011-8dd45803dfeb req-20861d95-512e-4f77-81f8-4735800a0289 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-9a2f7814-daf6-482c-8011-8dd45803dfeb req-20861d95-512e-4f77-81f8-4735800a0289 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:18 user nova-compute[75006]: WARNING nova.compute.manager [req-9a2f7814-daf6-482c-8011-8dd45803dfeb req-20861d95-512e-4f77-81f8-4735800a0289 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 for instance with vm_state building and task_state spawning.
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-99190b9e-be16-489c-8192-dea01baecb50 req-b69b956e-746b-474b-81ea-3bb5a41233c5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-99190b9e-be16-489c-8192-dea01baecb50 req-b69b956e-746b-474b-81ea-3bb5a41233c5 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-99190b9e-be16-489c-8192-dea01baecb50 req-b69b956e-746b-474b-81ea-3bb5a41233c5 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-99190b9e-be16-489c-8192-dea01baecb50 req-b69b956e-746b-474b-81ea-3bb5a41233c5 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-99190b9e-be16-489c-8192-dea01baecb50 req-b69b956e-746b-474b-81ea-3bb5a41233c5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:19 user nova-compute[75006]: WARNING nova.compute.manager [req-99190b9e-be16-489c-8192-dea01baecb50 req-b69b956e-746b-474b-81ea-3bb5a41233c5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 for instance with vm_state building and task_state spawning.
Nov 27 03:19:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:20 user nova-compute[75006]: WARNING nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 for instance with vm_state building and task_state spawning.
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:20 user nova-compute[75006]: WARNING nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 for instance with vm_state building and task_state spawning.
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:20 user nova-compute[75006]: WARNING nova.compute.manager [req-129fc253-f72b-4bee-ba49-010ba3da0db5 req-aab5998f-b0da-46ea-95fe-9bcf36faf4b1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 for instance with vm_state building and task_state spawning.
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:20 user nova-compute[75006]: WARNING nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 for instance with vm_state building and task_state spawning.
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:20 user nova-compute[75006]: WARNING nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 for instance with vm_state building and task_state spawning.
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:20 user nova-compute[75006]: WARNING nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 for instance with vm_state building and task_state spawning.
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:21 user nova-compute[75006]: WARNING nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a for instance with vm_state building and task_state spawning.
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:21 user nova-compute[75006]: WARNING nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a for instance with vm_state building and task_state spawning.
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:21 user nova-compute[75006]: WARNING nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 for instance with vm_state building and task_state spawning.
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:21 user nova-compute[75006]: WARNING nova.compute.manager [req-078248ea-69db-4851-b2a9-d831de2a8e2a req-0f8a0dc9-2aaa-4f26-a9a2-455875be16ce service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 for instance with vm_state building and task_state spawning.
Nov 27 03:19:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-e016c942-f0c6-4bde-85b6-c26855c8fd9e req-8eed3c34-bc64-4775-8cf9-731870b16a4f service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e016c942-f0c6-4bde-85b6-c26855c8fd9e req-8eed3c34-bc64-4775-8cf9-731870b16a4f service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e016c942-f0c6-4bde-85b6-c26855c8fd9e req-8eed3c34-bc64-4775-8cf9-731870b16a4f service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e016c942-f0c6-4bde-85b6-c26855c8fd9e req-8eed3c34-bc64-4775-8cf9-731870b16a4f service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-e016c942-f0c6-4bde-85b6-c26855c8fd9e req-8eed3c34-bc64-4775-8cf9-731870b16a4f service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:21 user nova-compute[75006]: WARNING nova.compute.manager [req-e016c942-f0c6-4bde-85b6-c26855c8fd9e req-8eed3c34-bc64-4775-8cf9-731870b16a4f service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 for instance with vm_state building and task_state spawning.
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:19:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance spawned successfully.
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:22 user nova-compute[75006]: INFO nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Took 11.45 seconds to spawn the instance on the hypervisor.
Nov 27 03:19:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:19:22 user nova-compute[75006]: INFO nova.compute.manager [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Took 33.85 seconds to build instance.
Nov 27 03:19:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef70babb-c0c6-48c1-ad9d-3018cf9de82f tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.974s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG nova.objects.instance [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lazy-loading 'flavor' on Instance uuid cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:34 user nova-compute[75006]: INFO nova.compute.manager [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Attaching volume 99c69e56-9c83-4618-ac5f-37ec2e4926f7 to /dev/vdb
Nov 27 03:19:34 user nova-compute[75006]: DEBUG os_brick.utils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e7cf8e-d73e-4560-a1ea-ab56a920bf7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b44a1-4ec8-4a83-967e-ab9f4dc19236]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[57514821-b498-43d4-8d00-d5a1f287c3a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2847eb-ab8d-4159-b696-145e8848d2e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:34 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:19:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d976fc08-d359-4baf-93ef-f530777e60f9]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG os_brick.utils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:34 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Updating existing volume attachment record: d2f030ef-6857-4bbd-b65a-af7227efb539 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:19:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:19:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahAkMeXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:41 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:41 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:41 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa664011-c67e-496b-b0ce-e8ed6969e18f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:19:41 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1287d2a-a36e-4461-8822-1a59a1ebb70b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7] added
Nov 27 03:19:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eef85bc-9c9a-4c21-9f70-b2f7630266d8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e9ba5-297b-4136-9d39-a40fd441d99f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahAkMeXg {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ahAkMeXg" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f38931-c350-45d0-8fc6-27036d3bf6a0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ahAkMeXg'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2129de0-b7bf-4bab-b1e0-367b14a0f3fb]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[62facaaa-5c4b-41b3-b629-c5d6416140b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65818cb-cb41-41a7-8101-d0a091c7ca16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7, portal: 172.16.0.220,3260]
Nov 27 03:19:41 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7, portal: 172.16.0.220,3260] successful.
Nov 27 03:19:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd4bebf-7e83-4f75-82c4-07c5e779b638]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5af368-1793-466b-8552-50b9c085761c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 (non-flash)
Nov 27 03:19:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:41 user nova-compute[75006]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 (non-flash)
Nov 27 03:19:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccf8114-3561-44f7-b26d-0ec5b43d6cfd]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:19:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahAkMeXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23030613765333136', 'path': '/dev/sdf'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030613765333136', 'path': '/dev/sdf'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lazy-loading 'flavor' on Instance uuid cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:19:42 user nova-compute[75006]: INFO nova.compute.claims [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Claim successful on node user
Nov 27 03:19:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:19:42 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:19:42 user nova-compute[75006]:   <source dev="/dev/sdf"/>
Nov 27 03:19:42 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:19:42 user nova-compute[75006]:   <serial>99c69e56-9c83-4618-ac5f-37ec2e4926f7</serial>
Nov 27 03:19:42 user nova-compute[75006]: </disk>
Nov 27 03:19:42 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:19:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] No VIF found with MAC fa:16:3e:b1:9e:37, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-886675c9-bf0f-4d16-abcc-2ba9d90a5e55 tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.633s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.780s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:19:43 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.policy [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5489e0f1a5c4bb1896c89ffaed79d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ca85c0868b6468fb2a3025ccd562f91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:43 user nova-compute[75006]: INFO nova.compute.manager [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Terminating instance
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:19:43 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Creating image(s)
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "/opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "/opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.194s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-e4b3ce66-3d50-4d85-be08-791f96cf10bd req-1adf23fa-87dc-4e81-bdb2-3530e004e89c service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received event network-vif-unplugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4b3ce66-3d50-4d85-be08-791f96cf10bd req-1adf23fa-87dc-4e81-bdb2-3530e004e89c service nova] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4b3ce66-3d50-4d85-be08-791f96cf10bd req-1adf23fa-87dc-4e81-bdb2-3530e004e89c service nova] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4b3ce66-3d50-4d85-be08-791f96cf10bd req-1adf23fa-87dc-4e81-bdb2-3530e004e89c service nova] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-e4b3ce66-3d50-4d85-be08-791f96cf10bd req-1adf23fa-87dc-4e81-bdb2-3530e004e89c service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] No waiting events found dispatching network-vif-unplugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-e4b3ce66-3d50-4d85-be08-791f96cf10bd req-1adf23fa-87dc-4e81-bdb2-3530e004e89c service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received event network-vif-unplugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.210s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk 1073741824" returned: 0 in 0.057s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Successfully created port: b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.222s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Instance destroyed successfully.
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.objects.instance [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lazy-loading 'resources' on Instance uuid cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Cannot resize image /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Ensure instance console log exists: /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1691578211',display_name='tempest-DeleteServersTestJSON-server-1691578211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1691578211',id=1,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='312b6ab93c494b1e83935e050f83e67c',ramdisk_id='',reservation_id='r-ww00enfj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1466743727',owner_user_name='tempest-DeleteServersTestJSON-1466743727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:17:56Z,user_data=None,user_id='99f4a1727f914876a12da8d0e18a31a8',uuid=cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Converting VIF {"id": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "address": "fa:16:3e:b1:9e:37", "network": {"id": "a36dda8a-3441-44aa-8cf5-00eeb0d35c31", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1677466957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "312b6ab93c494b1e83935e050f83e67c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1261e79-55", "ovs_interfaceid": "d1261e79-5578-40a6-a6d5-c84b660d05c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:37,bridge_name='br-int',has_traffic_filtering=True,id=d1261e79-5578-40a6-a6d5-c84b660d05c7,network=Network(a36dda8a-3441-44aa-8cf5-00eeb0d35c31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1261e79-55') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_vif [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:37,bridge_name='br-int',has_traffic_filtering=True,id=d1261e79-5578-40a6-a6d5-c84b660d05c7,network=Network(a36dda8a-3441-44aa-8cf5-00eeb0d35c31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1261e79-55') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1261e79-55, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca02e156-4621-465c-8c56-942f4419c298) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:44 user nova-compute[75006]: INFO os_vif [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:37,bridge_name='br-int',has_traffic_filtering=True,id=d1261e79-5578-40a6-a6d5-c84b660d05c7,network=Network(a36dda8a-3441-44aa-8cf5-00eeb0d35c31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1261e79-55')
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ahAkMeXg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12d63cd-4059-47ef-b005-2ef69ef98212]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:19:44 user nova-compute[75006]: No targets found.
Nov 27 03:19:44 user nova-compute[75006]: iSNS:
Nov 27 03:19:44 user nova-compute[75006]: No targets found.
Nov 27 03:19:44 user nova-compute[75006]: STATIC:
Nov 27 03:19:44 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:19:44 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:19:44 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:19:44 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7
Nov 27 03:19:44 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:19:44 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:19:44 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed
Nov 27 03:19:44 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:19:44 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:19:44 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d
Nov 27 03:19:44 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:19:44 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:19:44 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a
Nov 27 03:19:44 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:19:44 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:19:44 user nova-compute[75006]: FIRMWARE:
Nov 27 03:19:44 user nova-compute[75006]: No targets found.
Nov 27 03:19:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:19:44 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:19:44 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7813ba62-11f0-4d41-9ba5-a2c1e827e4b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc12931b-f23b-4563-a667-0dd5228db564]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:44 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:44 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:44 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:44 user nova-compute[75006]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 (non-flash)
Nov 27 03:19:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:44 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:44 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:44 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:44 user nova-compute[75006]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 (non-flash)
Nov 27 03:19:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd42458b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7'): ({'sdf'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Removing single pathed devices sdf {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d848b-cc68-4e3a-b38b-8334b67a0640]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b797d8-8650-4ce5-8453-71ee1ed463db]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Flushing IO for device /dev/sdf {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Successfully updated port: b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[272faab6-e9de-432d-9f37-108fae52e357]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "refresh_cache-3dd80363-c3bb-42ea-8ea5-ab23526fd395" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquired lock "refresh_cache-3dd80363-c3bb-42ea-8ea5-ab23526fd395" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-2ba4f312-089b-457e-a2cf-40a51ab6e6e4 req-876c9847-9b9a-4957-a3cf-f87a80950ef1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received event network-changed-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-2ba4f312-089b-457e-a2cf-40a51ab6e6e4 req-876c9847-9b9a-4957-a3cf-f87a80950ef1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Refreshing instance network info cache due to event network-changed-b3b07ec1-f48e-4536-bd16-b1fb42a0878a. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2ba4f312-089b-457e-a2cf-40a51ab6e6e4 req-876c9847-9b9a-4957-a3cf-f87a80950ef1 service nova] Acquiring lock "refresh_cache-3dd80363-c3bb-42ea-8ea5-ab23526fd395" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2063d6-bdbc-4bd1-bc13-987e56582226]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] SCSI volumes sdf have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff32dd-d566-42a3-a7c7-4a19d9117bd2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9821f9a-094f-4caf-9681-6ce5a833732e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7, portal: 172.16.0.220,3260]
Nov 27 03:19:44 user nova-compute[75006]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7, portal: 172.16.0.220,3260] successful.
Nov 27 03:19:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99c69e56-9c83-4618-ac5f-37ec2e4926f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac672d0-52d6-4924-a0ee-e3a3ac015aec]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] <== disconnect_volume: return (381ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:19:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Deleting instance files /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c_del
Nov 27 03:19:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Deletion of /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c_del complete
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json" returned: 1 in 0.166s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk --force-share --output=json' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:44 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000001, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c/disk
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75006) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 27 03:19:44 user nova-compute[75006]: INFO nova.virt.libvirt.host [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] UEFI support detected
Nov 27 03:19:44 user nova-compute[75006]: INFO nova.compute.manager [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Updating instance_info_cache with network_info: [{"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Releasing lock "refresh_cache-3dd80363-c3bb-42ea-8ea5-ab23526fd395" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Instance network_info: |[{"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2ba4f312-089b-457e-a2cf-40a51ab6e6e4 req-876c9847-9b9a-4957-a3cf-f87a80950ef1 service nova] Acquired lock "refresh_cache-3dd80363-c3bb-42ea-8ea5-ab23526fd395" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-2ba4f312-089b-457e-a2cf-40a51ab6e6e4 req-876c9847-9b9a-4957-a3cf-f87a80950ef1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Refreshing network info cache for port b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Start _get_guest_xml network_info=[{"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:19:45 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:19:45 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1833879037',display_name='tempest-ServersNegativeTestJSON-server-1833879037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1833879037',id=13,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ca85c0868b6468fb2a3025ccd562f91',ramdisk_id='',reservation_id='r-k01uynyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-809508397',owner_user_name='tempest-ServersNegativeTestJSON-809508397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:19:43Z,user_data=None,user_id='b5489e0f1a5c4bb1896c89ffaed79d77',uuid=3dd80363-c3bb-42ea-8ea5-ab23526fd395,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converting VIF {"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:81:40,bridge_name='br-int',has_traffic_filtering=True,id=b3b07ec1-f48e-4536-bd16-b1fb42a0878a,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b07ec1-f4') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.objects.instance [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dd80363-c3bb-42ea-8ea5-ab23526fd395 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:19:45 user nova-compute[75006]:   <uuid>3dd80363-c3bb-42ea-8ea5-ab23526fd395</uuid>
Nov 27 03:19:45 user nova-compute[75006]:   <name>instance-0000000d</name>
Nov 27 03:19:45 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:19:45 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:19:45 user nova-compute[75006]:   <metadata>
Nov 27 03:19:45 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:19:45 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:19:45 user nova-compute[75006]:       <nova:name>tempest-ServersNegativeTestJSON-server-1833879037</nova:name>
Nov 27 03:19:45 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:19:45</nova:creationTime>
Nov 27 03:19:45 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:19:45 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:19:45 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:19:45 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:19:45 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:19:45 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:19:45 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:19:45 user nova-compute[75006]:       <nova:owner>
Nov 27 03:19:45 user nova-compute[75006]:         <nova:user uuid="b5489e0f1a5c4bb1896c89ffaed79d77">tempest-ServersNegativeTestJSON-809508397-project-member</nova:user>
Nov 27 03:19:45 user nova-compute[75006]:         <nova:project uuid="9ca85c0868b6468fb2a3025ccd562f91">tempest-ServersNegativeTestJSON-809508397</nova:project>
Nov 27 03:19:45 user nova-compute[75006]:       </nova:owner>
Nov 27 03:19:45 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:19:45 user nova-compute[75006]:       <nova:ports>
Nov 27 03:19:45 user nova-compute[75006]:         <nova:port uuid="b3b07ec1-f48e-4536-bd16-b1fb42a0878a">
Nov 27 03:19:45 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 03:19:45 user nova-compute[75006]:         </nova:port>
Nov 27 03:19:45 user nova-compute[75006]:       </nova:ports>
Nov 27 03:19:45 user nova-compute[75006]:     </nova:instance>
Nov 27 03:19:45 user nova-compute[75006]:   </metadata>
Nov 27 03:19:45 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:19:45 user nova-compute[75006]:     <system>
Nov 27 03:19:45 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:19:45 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:19:45 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:19:45 user nova-compute[75006]:       <entry name="serial">3dd80363-c3bb-42ea-8ea5-ab23526fd395</entry>
Nov 27 03:19:45 user nova-compute[75006]:       <entry name="uuid">3dd80363-c3bb-42ea-8ea5-ab23526fd395</entry>
Nov 27 03:19:45 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:19:45 user nova-compute[75006]:     </system>
Nov 27 03:19:45 user nova-compute[75006]:   </sysinfo>
Nov 27 03:19:45 user nova-compute[75006]:   <os>
Nov 27 03:19:45 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:19:45 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:19:45 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:19:45 user nova-compute[75006]:   </os>
Nov 27 03:19:45 user nova-compute[75006]:   <features>
Nov 27 03:19:45 user nova-compute[75006]:     <acpi/>
Nov 27 03:19:45 user nova-compute[75006]:     <apic/>
Nov 27 03:19:45 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:19:45 user nova-compute[75006]:   </features>
Nov 27 03:19:45 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:19:45 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:19:45 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:19:45 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:19:45 user nova-compute[75006]:   </clock>
Nov 27 03:19:45 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:19:45 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:19:45 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:19:45 user nova-compute[75006]:   </cpu>
Nov 27 03:19:45 user nova-compute[75006]:   <devices>
Nov 27 03:19:45 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:19:45 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:19:45 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk"/>
Nov 27 03:19:45 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:19:45 user nova-compute[75006]:     </disk>
Nov 27 03:19:45 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:19:45 user nova-compute[75006]:       <mac address="fa:16:3e:65:81:40"/>
Nov 27 03:19:45 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:45 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:19:45 user nova-compute[75006]:       <target dev="tapb3b07ec1-f4"/>
Nov 27 03:19:45 user nova-compute[75006]:     </interface>
Nov 27 03:19:45 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:19:45 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/console.log" append="off"/>
Nov 27 03:19:45 user nova-compute[75006]:     </serial>
Nov 27 03:19:45 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:19:45 user nova-compute[75006]:     <video>
Nov 27 03:19:45 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:19:45 user nova-compute[75006]:     </video>
Nov 27 03:19:45 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:19:45 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:19:45 user nova-compute[75006]:     </rng>
Nov 27 03:19:45 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:19:45 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:19:45 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:19:45 user nova-compute[75006]:     </memballoon>
Nov 27 03:19:45 user nova-compute[75006]:   </devices>
Nov 27 03:19:45 user nova-compute[75006]: </domain>
Nov 27 03:19:45 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1833879037',display_name='tempest-ServersNegativeTestJSON-server-1833879037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1833879037',id=13,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ca85c0868b6468fb2a3025ccd562f91',ramdisk_id='',reservation_id='r-k01uynyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-809508397',owner_user_name='tempest-ServersNegativeTestJSON-809508397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:19:43Z,user_data=None,user_id='b5489e0f1a5c4bb1896c89ffaed79d77',uuid=3dd80363-c3bb-42ea-8ea5-ab23526fd395,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converting VIF {"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:81:40,bridge_name='br-int',has_traffic_filtering=True,id=b3b07ec1-f48e-4536-bd16-b1fb42a0878a,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b07ec1-f4') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG os_vif [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:81:40,bridge_name='br-int',has_traffic_filtering=True,id=b3b07ec1-f48e-4536-bd16-b1fb42a0878a,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b07ec1-f4') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd64d3bd-1493-55bf-99b6-c83275cd7058', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3b07ec1-f4, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3b07ec1-f4, col_values=(('qos', UUID('35471f39-314d-444b-9ebf-be1fd650a407')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3b07ec1-f4, col_values=(('external_ids', {'iface-id': 'b3b07ec1-f48e-4536-bd16-b1fb42a0878a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:81:40', 'vm-uuid': '3dd80363-c3bb-42ea-8ea5-ab23526fd395'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:45 user nova-compute[75006]: INFO os_vif [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:81:40,bridge_name='br-int',has_traffic_filtering=True,id=b3b07ec1-f48e-4536-bd16-b1fb42a0878a,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b07ec1-f4')
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] No VIF found with MAC fa:16:3e:65:81:40, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-375bb8e5-4c39-4b96-adcc-74bc2349f6fc req-74db8a99-8182-4d9b-91c2-39b77ad5c730 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received event network-vif-deleted-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:45 user nova-compute[75006]: INFO nova.compute.manager [req-375bb8e5-4c39-4b96-adcc-74bc2349f6fc req-74db8a99-8182-4d9b-91c2-39b77ad5c730 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Neutron deleted interface d1261e79-5578-40a6-a6d5-c84b660d05c7; detaching it from the instance and deleting it from the info cache
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.network.neutron [req-375bb8e5-4c39-4b96-adcc-74bc2349f6fc req-74db8a99-8182-4d9b-91c2-39b77ad5c730 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:45 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Took 0.68 seconds to deallocate network for instance.
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-375bb8e5-4c39-4b96-adcc-74bc2349f6fc req-74db8a99-8182-4d9b-91c2-39b77ad5c730 service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Detach interface failed, port_id=d1261e79-5578-40a6-a6d5-c84b660d05c7, reason: Instance cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.network.neutron [req-2ba4f312-089b-457e-a2cf-40a51ab6e6e4 req-876c9847-9b9a-4957-a3cf-f87a80950ef1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Updated VIF entry in instance network info cache for port b3b07ec1-f48e-4536-bd16-b1fb42a0878a. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.network.neutron [req-2ba4f312-089b-457e-a2cf-40a51ab6e6e4 req-876c9847-9b9a-4957-a3cf-f87a80950ef1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Updating instance_info_cache with network_info: [{"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2ba4f312-089b-457e-a2cf-40a51ab6e6e4 req-876c9847-9b9a-4957-a3cf-f87a80950ef1 service nova] Releasing lock "refresh_cache-3dd80363-c3bb-42ea-8ea5-ab23526fd395" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f89f082-947e-4436-af8b-fbe9a821e253 req-f6e5943b-8f59-4e6a-b539-8297d14551de service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received event network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f89f082-947e-4436-af8b-fbe9a821e253 req-f6e5943b-8f59-4e6a-b539-8297d14551de service nova] Acquiring lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f89f082-947e-4436-af8b-fbe9a821e253 req-f6e5943b-8f59-4e6a-b539-8297d14551de service nova] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f89f082-947e-4436-af8b-fbe9a821e253 req-f6e5943b-8f59-4e6a-b539-8297d14551de service nova] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f89f082-947e-4436-af8b-fbe9a821e253 req-f6e5943b-8f59-4e6a-b539-8297d14551de service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] No waiting events found dispatching network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:45 user nova-compute[75006]: WARNING nova.compute.manager [req-3f89f082-947e-4436-af8b-fbe9a821e253 req-f6e5943b-8f59-4e6a-b539-8297d14551de service nova] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Received unexpected event network-vif-plugged-d1261e79-5578-40a6-a6d5-c84b660d05c7 for instance with vm_state active and task_state deleting.
Nov 27 03:19:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:48 user nova-compute[75006]: INFO nova.compute.manager [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] [instance: cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c] Took 3.27 seconds to detach 1 volumes for instance.
Nov 27 03:19:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received event network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Acquiring lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] No waiting events found dispatching network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:48 user nova-compute[75006]: WARNING nova.compute.manager [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received unexpected event network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a for instance with vm_state building and task_state spawning.
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received event network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Acquiring lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] No waiting events found dispatching network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:19:48 user nova-compute[75006]: WARNING nova.compute.manager [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received unexpected event network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a for instance with vm_state building and task_state spawning.
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-changed-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Refreshing instance network info cache due to event network-changed-1f7e81ab-1878-407b-a8fe-02ea2918ff76. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Acquiring lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Acquired lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.network.neutron [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Refreshing network info cache for port 1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-cedd85a0-0c3d-4a30-a6ce-045e795f1aac req-aab41d07-3ab8-44cb-805e-dd471fe8ae04 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received event network-changed-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-cedd85a0-0c3d-4a30-a6ce-045e795f1aac req-aab41d07-3ab8-44cb-805e-dd471fe8ae04 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Refreshing instance network info cache due to event network-changed-fe877835-a1ab-434a-8eff-de1db84f2425. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cedd85a0-0c3d-4a30-a6ce-045e795f1aac req-aab41d07-3ab8-44cb-805e-dd471fe8ae04 service nova] Acquiring lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cedd85a0-0c3d-4a30-a6ce-045e795f1aac req-aab41d07-3ab8-44cb-805e-dd471fe8ae04 service nova] Acquired lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.network.neutron [req-cedd85a0-0c3d-4a30-a6ce-045e795f1aac req-aab41d07-3ab8-44cb-805e-dd471fe8ae04 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Refreshing network info cache for port fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-00ddc67b-ce12-4daa-85a8-586bea90e117 req-1a91c0c6-22e8-426d-ab6b-a2b3138786ef service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-changed-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-00ddc67b-ce12-4daa-85a8-586bea90e117 req-1a91c0c6-22e8-426d-ab6b-a2b3138786ef service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Refreshing instance network info cache due to event network-changed-f94812d5-e03a-40d6-88c1-6fe71880aa1d. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-00ddc67b-ce12-4daa-85a8-586bea90e117 req-1a91c0c6-22e8-426d-ab6b-a2b3138786ef service nova] Acquiring lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-00ddc67b-ce12-4daa-85a8-586bea90e117 req-1a91c0c6-22e8-426d-ab6b-a2b3138786ef service nova] Acquired lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.network.neutron [req-00ddc67b-ce12-4daa-85a8-586bea90e117 req-1a91c0c6-22e8-426d-ab6b-a2b3138786ef service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Refreshing network info cache for port f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:19:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:19:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=6708MB free_disk=25.564746856689453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Instance spawned successfully.
Nov 27 03:19:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:49 user nova-compute[75006]: INFO nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fd992ae2-0b97-47d2-9e03-f707af65f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5ee0634e-e918-4e98-a42c-496e3f7de095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6fb3b75d-a685-4aec-af12-b4c530695174 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 8192463c-0589-4a75-97ec-24a5d9149c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 503a960f-c3f6-4b8f-af89-7796916be32c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fc95fb16-d2f5-4f45-ac78-bcd060f585a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5956b54a-82d6-44f4-95f6-e92408ea924d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 3dd80363-c3bb-42ea-8ea5-ab23526fd395 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:19:49 user nova-compute[75006]: INFO nova.compute.manager [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Took 6.96 seconds to build instance.
Nov 27 03:19:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd1d658a-ebc1-42fc-b2b7-1d749e02e7a9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.124s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.network.neutron [req-cedd85a0-0c3d-4a30-a6ce-045e795f1aac req-aab41d07-3ab8-44cb-805e-dd471fe8ae04 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updated VIF entry in instance network info cache for port fe877835-a1ab-434a-8eff-de1db84f2425. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.network.neutron [req-cedd85a0-0c3d-4a30-a6ce-045e795f1aac req-aab41d07-3ab8-44cb-805e-dd471fe8ae04 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updating instance_info_cache with network_info: [{"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cedd85a0-0c3d-4a30-a6ce-045e795f1aac req-aab41d07-3ab8-44cb-805e-dd471fe8ae04 service nova] Releasing lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.network.neutron [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updated VIF entry in instance network info cache for port 1f7e81ab-1878-407b-a8fe-02ea2918ff76. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.network.neutron [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.network.neutron [req-00ddc67b-ce12-4daa-85a8-586bea90e117 req-1a91c0c6-22e8-426d-ab6b-a2b3138786ef service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updated VIF entry in instance network info cache for port f94812d5-e03a-40d6-88c1-6fe71880aa1d. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.network.neutron [req-00ddc67b-ce12-4daa-85a8-586bea90e117 req-1a91c0c6-22e8-426d-ab6b-a2b3138786ef service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3f4a18e3-7851-47e6-babe-f695edb25965 req-b81156a1-ae87-4ed0-a06a-5bd42eb4b592 service nova] Releasing lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-00ddc67b-ce12-4daa-85a8-586bea90e117 req-1a91c0c6-22e8-426d-ab6b-a2b3138786ef service nova] Releasing lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.778s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.669s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:19:50 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Deleted allocations for instance cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c
Nov 27 03:19:50 user nova-compute[75006]: INFO nova.compute.manager [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] instance snapshotting
Nov 27 03:19:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Beginning live snapshot process
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-44254671-a937-42db-a71f-056e8873938e tempest-DeleteServersTestJSON-1466743727 tempest-DeleteServersTestJSON-1466743727-project-member] Lock "cffbb56e-e7b7-4fc9-9f37-0ab7b206af5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.088s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json -f qcow2 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:19:50 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json -f qcow2 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:51 user nova-compute[75006]: INFO nova.compute.manager [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Attaching volume 2500f817-c1b9-4704-b404-22a17c6a0231 to /dev/vdb
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG os_brick.utils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df60a87-2432-4f25-aef4-8a0a90ecaa2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[49439544-de8a-4219-b889-3552d29e66a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7c354d-6ed0-480a-9a29-a83f3b2c5559]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d2c351-7e17-46b6-8674-8dbd98eb4efc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG nova.objects.instance [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid 5ee0634e-e918-4e98-a42c-496e3f7de095 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.220s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:51 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b7be6a-943d-4162-8675-b8a1bae69111]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw26oaitu/168c8bf5bd7a4d0297f7db7584d0a75f.delta 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG os_brick.utils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating existing volume attachment record: 8474d88a-1382-4737-9d63-32727bb6587a {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpw26oaitu/168c8bf5bd7a4d0297f7db7584d0a75f.delta 1073741824" returned: 0 in 0.061s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.141s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Updating instance_info_cache with network_info: [{"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:19:51 user nova-compute[75006]: INFO nova.compute.manager [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Attaching volume d7ac48ee-8f75-4152-97fd-119cb30bb7eb to /dev/vdb
Nov 27 03:19:51 user nova-compute[75006]: DEBUG os_brick.utils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ad9511-a95e-4cdb-9ff1-d39e0961ac3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07ee6a4-583a-4aef-b831-9ff7d4778f74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2450230e-dd45-48bc-9f4b-83b885b60cb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6affb481-af30-49e6-b813-28992f740b1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:19:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:19:52 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:19:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0b5dd2-773d-4d8b-823c-36303351c064]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:19:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:19:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:19:52 user nova-compute[75006]: DEBUG os_brick.utils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:52 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updating existing volume attachment record: d5acdc84-f2a6-4d34-ab4f-86676fd23154 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:19:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:19:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] COPY block job progress, current cursor: 23527424 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:19:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:19:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 03:19:53 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:19:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw26oaitu/168c8bf5bd7a4d0297f7db7584d0a75f.delta /opt/stack/data/nova/instances/snapshots/tmpw26oaitu/168c8bf5bd7a4d0297f7db7584d0a75f {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpw26oaitu/168c8bf5bd7a4d0297f7db7584d0a75f.delta /opt/stack/data/nova/instances/snapshots/tmpw26oaitu/168c8bf5bd7a4d0297f7db7584d0a75f" returned: 0 in 0.632s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Snapshot extracted, beginning image upload
Nov 27 03:19:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:57 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Snapshot image upload complete
Nov 27 03:19:57 user nova-compute[75006]: INFO nova.compute.manager [None req-10eb6590-92d2-4651-8a49-d470c88225b4 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Took 7.09 seconds to snapshot the instance on the hypervisor.
Nov 27 03:19:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJYKSaHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:58 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:58 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:58 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf46e8c-b965-4647-b368-f4044b2ca800]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:19:58 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[34744972-f039-4a2d-9cc6-a38f11e0e25c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231] added
Nov 27 03:19:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a9c8c0-8ac0-42a7-b355-48929e8a8b78]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d56f441-a401-4d0f-b8a7-e93bb5b3e1d2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJYKSaHO {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJYKSaHO" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9e59c0-d457-4eee-a618-00844065390d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kJYKSaHO'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfWIYges', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:19:58 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3f5edc-6e6f-4848-aefd-83c3ca1d023a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcff506-a00f-4c0f-b9c1-12c2ffcc0a12]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8b489c-5b18-40c2-8610-46b8a4f764d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260]
Nov 27 03:19:58 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260] successful.
Nov 27 03:19:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce1e919-acca-4f88-9b42-cd80624492eb]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4817eb78-8b31-4f22-903f-a2b94c18e524]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:19:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:58 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:19:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[21daec38-7535-403b-934f-c72911da8602]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:19:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJYKSaHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26434623035353437', 'path': '/dev/sdf'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434623035353437', 'path': '/dev/sdf'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.190s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:59 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:19:59 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdee574-cca7-4d0f-8ff2-c720eef8ffc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:19:59 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:19:59 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:19:59 user nova-compute[75006]:   <source dev="/dev/sdf"/>
Nov 27 03:19:59 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:19:59 user nova-compute[75006]:   <serial>2500f817-c1b9-4704-b404-22a17c6a0231</serial>
Nov 27 03:19:59 user nova-compute[75006]: </disk>
Nov 27 03:19:59 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6c7d0-e83c-4f37-b649-b8c33ca2fec0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb] added
Nov 27 03:19:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.051s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca123ad2-09fc-4f49-90d0-79fe29b3f494]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d2bd6-7662-45d0-a22f-cdfe0284909f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfWIYges {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BfWIYges" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d38b7-fc8a-47c2-9e6d-23daba493666]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BfWIYges'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[089174c0-d0f2-429e-bbad-196d249c6f45]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bbd9fe-07dc-46ad-bfc0-48fd1407f261]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:19:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:19:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd9723-3cb5-40b9-aa9b-564b0b8be61f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb, portal: 172.16.0.220,3260]
Nov 27 03:19:59 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb, portal: 172.16.0.220,3260] successful.
Nov 27 03:19:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5e1dd8-b0c1-4044-afbc-81ad73a4d279]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a0efbe-b021-472e-86af-864a55edb09e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:19:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:19:59 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:19:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[89364f46-4ab5-49db-832b-7d45b5742ee3]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:19:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfWIYges', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:20:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No VIF found with MAC fa:16:3e:1a:de:2b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:20:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e22b06d9-6985-4635-8ff6-6782e6c08577 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.974s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== connect_volume: return (2551ms) {'type': 'block', 'scsi_wwn': '23230303835666366', 'path': '/dev/sdg'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230303835666366', 'path': '/dev/sdg'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid 5ee0634e-e918-4e98-a42c-496e3f7de095 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:20:01 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:01 user nova-compute[75006]:   <source dev="/dev/sdg"/>
Nov 27 03:20:01 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:01 user nova-compute[75006]:   <serial>d7ac48ee-8f75-4152-97fd-119cb30bb7eb</serial>
Nov 27 03:20:01 user nova-compute[75006]: </disk>
Nov 27 03:20:01 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c67a24d-9ba3-412b-8290-1b938f32df5a tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c67a24d-9ba3-412b-8290-1b938f32df5a tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3c67a24d-9ba3-412b-8290-1b938f32df5a tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3c67a24d-9ba3-412b-8290-1b938f32df5a tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75006) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3c67a24d-9ba3-412b-8290-1b938f32df5a tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No VIF found with MAC fa:16:3e:1b:c7:bd, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-567be461-c5d9-41e7-ba63-2dd4edde4b44 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.796s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance destroyed successfully.
Nov 27 03:20:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3c67a24d-9ba3-412b-8290-1b938f32df5a tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:20:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-4b081c43-ea16-45b9-8956-32a1c81d83be req-cd4cf5d1-bb1d-45ba-9d8e-e9fe9fc8d037 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4b081c43-ea16-45b9-8956-32a1c81d83be req-cd4cf5d1-bb1d-45ba-9d8e-e9fe9fc8d037 service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4b081c43-ea16-45b9-8956-32a1c81d83be req-cd4cf5d1-bb1d-45ba-9d8e-e9fe9fc8d037 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4b081c43-ea16-45b9-8956-32a1c81d83be req-cd4cf5d1-bb1d-45ba-9d8e-e9fe9fc8d037 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-4b081c43-ea16-45b9-8956-32a1c81d83be req-cd4cf5d1-bb1d-45ba-9d8e-e9fe9fc8d037 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:02 user nova-compute[75006]: WARNING nova.compute.manager [req-4b081c43-ea16-45b9-8956-32a1c81d83be req-cd4cf5d1-bb1d-45ba-9d8e-e9fe9fc8d037 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state active and task_state powering-off.
Nov 27 03:20:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c67a24d-9ba3-412b-8290-1b938f32df5a tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.010s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received event network-changed-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Refreshing instance network info cache due to event network-changed-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] Acquiring lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] Acquired lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Refreshing network info cache for port db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:20:04 user nova-compute[75006]: INFO nova.compute.claims [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Claim successful on node user
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updated VIF entry in instance network info cache for port db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updating instance_info_cache with network_info: [{"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] Releasing lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:04 user nova-compute[75006]: WARNING nova.compute.manager [req-9e96f2e7-f41b-4ff3-b94f-9e1dd8178451 req-fb3edf97-5368-4379-a7cb-ab43fdac384c service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state stopped and task_state None.
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-2802a1fa-8f5d-46e7-924d-d6a5cdd3477b req-a023974c-5285-4791-bb40-4d02b93d92a8 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received event network-changed-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-2802a1fa-8f5d-46e7-924d-d6a5cdd3477b req-a023974c-5285-4791-bb40-4d02b93d92a8 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Refreshing instance network info cache due to event network-changed-587db899-908f-449e-917e-5becb867f54d. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2802a1fa-8f5d-46e7-924d-d6a5cdd3477b req-a023974c-5285-4791-bb40-4d02b93d92a8 service nova] Acquiring lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2802a1fa-8f5d-46e7-924d-d6a5cdd3477b req-a023974c-5285-4791-bb40-4d02b93d92a8 service nova] Acquired lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-2802a1fa-8f5d-46e7-924d-d6a5cdd3477b req-a023974c-5285-4791-bb40-4d02b93d92a8 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Refreshing network info cache for port 587db899-908f-449e-917e-5becb867f54d {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lazy-loading 'flavor' on Instance uuid 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.policy [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1836d0da810f4525addd0b02ae57c617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30af4989ad4414083de0576cf4dbd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:20:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Creating image(s)
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "/opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "/opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:05 user nova-compute[75006]: INFO nova.compute.manager [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Attaching volume 68b19fab-ae00-4f1b-8408-63bcac3150e4 to /dev/vdb
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-2802a1fa-8f5d-46e7-924d-d6a5cdd3477b req-a023974c-5285-4791-bb40-4d02b93d92a8 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Updated VIF entry in instance network info cache for port 587db899-908f-449e-917e-5becb867f54d. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-2802a1fa-8f5d-46e7-924d-d6a5cdd3477b req-a023974c-5285-4791-bb40-4d02b93d92a8 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Updating instance_info_cache with network_info: [{"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG os_brick.utils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2802a1fa-8f5d-46e7-924d-d6a5cdd3477b req-a023974c-5285-4791-bb40-4d02b93d92a8 service nova] Releasing lock "refresh_cache-6fb3b75d-a685-4aec-af12-b4c530695174" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeffe9c-b795-4d2a-ab15-683877e489e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[444f4fee-2133-438b-a010-b7f7f13b7a3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ec2273-be93-457d-89a7-661a99991793]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd36aa8e-d21c-4e90-b29b-d5781509092f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:05 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0bec84-efd5-46d3-9ea5-7ffe6352a2a0]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG os_brick.utils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updating existing volume attachment record: dd527519-4270-4678-8911-f76d45d1fcd4 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk 1073741824" returned: 0 in 0.045s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Successfully created port: 1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Cannot resize image /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Ensure instance console log exists: /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Successfully updated port: 1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquired lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-d3000e69-d8c2-416a-ade6-3b074abfc005 req-4b1db49c-e978-4405-9854-74663845d9db service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received event network-changed-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-d3000e69-d8c2-416a-ade6-3b074abfc005 req-4b1db49c-e978-4405-9854-74663845d9db service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Refreshing instance network info cache due to event network-changed-1e445a88-b315-40e5-824c-f937bb4e4c97. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d3000e69-d8c2-416a-ade6-3b074abfc005 req-4b1db49c-e978-4405-9854-74663845d9db service nova] Acquiring lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Updating instance_info_cache with network_info: [{"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Releasing lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Instance network_info: |[{"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d3000e69-d8c2-416a-ade6-3b074abfc005 req-4b1db49c-e978-4405-9854-74663845d9db service nova] Acquired lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.network.neutron [req-d3000e69-d8c2-416a-ade6-3b074abfc005 req-4b1db49c-e978-4405-9854-74663845d9db service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Refreshing network info cache for port 1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Start _get_guest_xml network_info=[{"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:20:07 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:20:07 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-494812',display_name='tempest-AttachVolumeNegativeTest-server-494812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-494812',id=14,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6wqbCOAOtkuwMNPFkjVE137c247d52y7rO9KJcmKBzg/OVTUwwviYtHSw3+0X6RDwKS8JNQFQHfWSjf47/2dicamQDJTvKvQ+r9n2KiB+RnMw+kv0nHW+s/+rw6QtntA==',key_name='tempest-keypair-1965800954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-ctxe98jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:20:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=f6c29a59-34d3-4aa9-8c87-447f0b3a0f74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:08:1b,bridge_name='br-int',has_traffic_filtering=True,id=1e445a88-b315-40e5-824c-f937bb4e4c97,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e445a88-b3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.objects.instance [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'pci_devices' on Instance uuid f6c29a59-34d3-4aa9-8c87-447f0b3a0f74 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:20:07 user nova-compute[75006]:   <uuid>f6c29a59-34d3-4aa9-8c87-447f0b3a0f74</uuid>
Nov 27 03:20:07 user nova-compute[75006]:   <name>instance-0000000e</name>
Nov 27 03:20:07 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:20:07 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:20:07 user nova-compute[75006]:   <metadata>
Nov 27 03:20:07 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:20:07 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:20:07 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeNegativeTest-server-494812</nova:name>
Nov 27 03:20:07 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:20:07</nova:creationTime>
Nov 27 03:20:07 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:20:07 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:20:07 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:20:07 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:20:07 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:20:07 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:20:07 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:20:07 user nova-compute[75006]:       <nova:owner>
Nov 27 03:20:07 user nova-compute[75006]:         <nova:user uuid="1836d0da810f4525addd0b02ae57c617">tempest-AttachVolumeNegativeTest-66969864-project-member</nova:user>
Nov 27 03:20:07 user nova-compute[75006]:         <nova:project uuid="f30af4989ad4414083de0576cf4dbd48">tempest-AttachVolumeNegativeTest-66969864</nova:project>
Nov 27 03:20:07 user nova-compute[75006]:       </nova:owner>
Nov 27 03:20:07 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:20:07 user nova-compute[75006]:       <nova:ports>
Nov 27 03:20:07 user nova-compute[75006]:         <nova:port uuid="1e445a88-b315-40e5-824c-f937bb4e4c97">
Nov 27 03:20:07 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 03:20:07 user nova-compute[75006]:         </nova:port>
Nov 27 03:20:07 user nova-compute[75006]:       </nova:ports>
Nov 27 03:20:07 user nova-compute[75006]:     </nova:instance>
Nov 27 03:20:07 user nova-compute[75006]:   </metadata>
Nov 27 03:20:07 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:20:07 user nova-compute[75006]:     <system>
Nov 27 03:20:07 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:20:07 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:20:07 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:20:07 user nova-compute[75006]:       <entry name="serial">f6c29a59-34d3-4aa9-8c87-447f0b3a0f74</entry>
Nov 27 03:20:07 user nova-compute[75006]:       <entry name="uuid">f6c29a59-34d3-4aa9-8c87-447f0b3a0f74</entry>
Nov 27 03:20:07 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:20:07 user nova-compute[75006]:     </system>
Nov 27 03:20:07 user nova-compute[75006]:   </sysinfo>
Nov 27 03:20:07 user nova-compute[75006]:   <os>
Nov 27 03:20:07 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:20:07 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:20:07 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:20:07 user nova-compute[75006]:   </os>
Nov 27 03:20:07 user nova-compute[75006]:   <features>
Nov 27 03:20:07 user nova-compute[75006]:     <acpi/>
Nov 27 03:20:07 user nova-compute[75006]:     <apic/>
Nov 27 03:20:07 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:20:07 user nova-compute[75006]:   </features>
Nov 27 03:20:07 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:20:07 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:20:07 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:20:07 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:20:07 user nova-compute[75006]:   </clock>
Nov 27 03:20:07 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:20:07 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:20:07 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:20:07 user nova-compute[75006]:   </cpu>
Nov 27 03:20:07 user nova-compute[75006]:   <devices>
Nov 27 03:20:07 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:20:07 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:20:07 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk"/>
Nov 27 03:20:07 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:20:07 user nova-compute[75006]:     </disk>
Nov 27 03:20:07 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:20:07 user nova-compute[75006]:       <mac address="fa:16:3e:51:08:1b"/>
Nov 27 03:20:07 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:20:07 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:20:07 user nova-compute[75006]:       <target dev="tap1e445a88-b3"/>
Nov 27 03:20:07 user nova-compute[75006]:     </interface>
Nov 27 03:20:07 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:20:07 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/console.log" append="off"/>
Nov 27 03:20:07 user nova-compute[75006]:     </serial>
Nov 27 03:20:07 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:20:07 user nova-compute[75006]:     <video>
Nov 27 03:20:07 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:20:07 user nova-compute[75006]:     </video>
Nov 27 03:20:07 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:20:07 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:20:07 user nova-compute[75006]:     </rng>
Nov 27 03:20:07 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:20:07 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:20:07 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:20:07 user nova-compute[75006]:     </memballoon>
Nov 27 03:20:07 user nova-compute[75006]:   </devices>
Nov 27 03:20:07 user nova-compute[75006]: </domain>
Nov 27 03:20:07 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-494812',display_name='tempest-AttachVolumeNegativeTest-server-494812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-494812',id=14,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6wqbCOAOtkuwMNPFkjVE137c247d52y7rO9KJcmKBzg/OVTUwwviYtHSw3+0X6RDwKS8JNQFQHfWSjf47/2dicamQDJTvKvQ+r9n2KiB+RnMw+kv0nHW+s/+rw6QtntA==',key_name='tempest-keypair-1965800954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-ctxe98jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:20:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=f6c29a59-34d3-4aa9-8c87-447f0b3a0f74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:08:1b,bridge_name='br-int',has_traffic_filtering=True,id=1e445a88-b315-40e5-824c-f937bb4e4c97,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e445a88-b3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG os_vif [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:08:1b,bridge_name='br-int',has_traffic_filtering=True,id=1e445a88-b315-40e5-824c-f937bb4e4c97,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e445a88-b3') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '118bcd10-0991-5029-961f-787d7f7e03fa', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e445a88-b3, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e445a88-b3, col_values=(('qos', UUID('b75d91e7-ffd9-47bf-a376-0079b662e1ef')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e445a88-b3, col_values=(('external_ids', {'iface-id': '1e445a88-b315-40e5-824c-f937bb4e4c97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:08:1b', 'vm-uuid': 'f6c29a59-34d3-4aa9-8c87-447f0b3a0f74'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:07 user nova-compute[75006]: INFO os_vif [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:08:1b,bridge_name='br-int',has_traffic_filtering=True,id=1e445a88-b315-40e5-824c-f937bb4e4c97,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e445a88-b3')
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No VIF found with MAC fa:16:3e:51:08:1b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.network.neutron [req-d3000e69-d8c2-416a-ade6-3b074abfc005 req-4b1db49c-e978-4405-9854-74663845d9db service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Updated VIF entry in instance network info cache for port 1e445a88-b315-40e5-824c-f937bb4e4c97. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.network.neutron [req-d3000e69-d8c2-416a-ade6-3b074abfc005 req-4b1db49c-e978-4405-9854-74663845d9db service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Updating instance_info_cache with network_info: [{"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d3000e69-d8c2-416a-ade6-3b074abfc005 req-4b1db49c-e978-4405-9854-74663845d9db service nova] Releasing lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lazy-loading 'flavor' on Instance uuid 6fb3b75d-a685-4aec-af12-b4c530695174 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:08 user nova-compute[75006]: INFO nova.compute.manager [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Attaching volume 9947a8d0-3952-4526-9f4c-544d5d09a11e to /dev/sdc
Nov 27 03:20:08 user nova-compute[75006]: DEBUG os_brick.utils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2c3e4-ba73-4130-b275-b0fa552d865b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b02264-93cc-430b-85f1-8f0da4100311]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57b6e6f-afac-4bf1-8058-dbc279494544]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cb3af5-6d0e-4e47-b058-38738ea7b95a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:08 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab71c914-d16a-43ad-a6af-784f39f1bfe2]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG os_brick.utils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Updating existing volume attachment record: 00005102-b667-41f6-b78b-a9b682f47a5f {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG nova.compute.manager [req-5f29f861-e223-4aa6-a64e-d442fa158bb5 req-9619b3db-2523-41af-834f-426995718aef service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received event network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f29f861-e223-4aa6-a64e-d442fa158bb5 req-9619b3db-2523-41af-834f-426995718aef service nova] Acquiring lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f29f861-e223-4aa6-a64e-d442fa158bb5 req-9619b3db-2523-41af-834f-426995718aef service nova] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f29f861-e223-4aa6-a64e-d442fa158bb5 req-9619b3db-2523-41af-834f-426995718aef service nova] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG nova.compute.manager [req-5f29f861-e223-4aa6-a64e-d442fa158bb5 req-9619b3db-2523-41af-834f-426995718aef service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] No waiting events found dispatching network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:08 user nova-compute[75006]: WARNING nova.compute.manager [req-5f29f861-e223-4aa6-a64e-d442fa158bb5 req-9619b3db-2523-41af-834f-426995718aef service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received unexpected event network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 for instance with vm_state building and task_state spawning.
Nov 27 03:20:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:20:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Instance spawned successfully.
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a5feea-07b8-42e3-8fff-378680362a50 req-eaa4f063-be8a-4e86-ba79-057e2b26a333 service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received event network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a5feea-07b8-42e3-8fff-378680362a50 req-eaa4f063-be8a-4e86-ba79-057e2b26a333 service nova] Acquiring lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a5feea-07b8-42e3-8fff-378680362a50 req-eaa4f063-be8a-4e86-ba79-057e2b26a333 service nova] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a5feea-07b8-42e3-8fff-378680362a50 req-eaa4f063-be8a-4e86-ba79-057e2b26a333 service nova] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a5feea-07b8-42e3-8fff-378680362a50 req-eaa4f063-be8a-4e86-ba79-057e2b26a333 service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] No waiting events found dispatching network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:10 user nova-compute[75006]: WARNING nova.compute.manager [req-b2a5feea-07b8-42e3-8fff-378680362a50 req-eaa4f063-be8a-4e86-ba79-057e2b26a333 service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received unexpected event network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 for instance with vm_state building and task_state spawning.
Nov 27 03:20:10 user nova-compute[75006]: INFO nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 27 03:20:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:20:10 user nova-compute[75006]: INFO nova.compute.manager [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Took 6.31 seconds to build instance.
Nov 27 03:20:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f638ce5a-e319-47d0-91e0-d8912e1d62f0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.403s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:11 user nova-compute[75006]: DEBUG nova.objects.instance [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lazy-loading 'flavor' on Instance uuid 78af3b73-bce3-4e4b-b040-eda0d6af7050 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:12 user nova-compute[75006]: INFO nova.compute.manager [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Attaching volume fe428d41-58e9-4036-a448-50de57a0b833 to /dev/vdb
Nov 27 03:20:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.utils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb891ec-c088-4868-9878-08523cc95bef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b913e8-a0a5-480b-ae8c-f68315213f31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03e86b1-2036-4ca9-8e0e-cf304407c9d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8223a5b6-8948-427a-a726-7f7075c0593c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:12 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fd8a70-5a52-4275-8f4c-20393e04427f]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.utils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Updating existing volume attachment record: 27dc8534-4bff-4d2c-b723-ceff8c3a26da {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjRMlrDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:12 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:12 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:12 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb76fe4-69df-4212-ba2b-b46da8ffb6f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:20:12 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee247437-9cbc-4284-8d22-159e6f421880]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4] added
Nov 27 03:20:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31824db-0a55-4ec9-a054-41f9654dbead]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4f4c11-afa4-4aab-b81f-209ff169c527]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjRMlrDF {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-5de4ce56-0141-4589-bf9c-1cd4820ccdba req-703511fb-23f2-47b6-acec-39ced30ca91d service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Received event network-changed-84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-5de4ce56-0141-4589-bf9c-1cd4820ccdba req-703511fb-23f2-47b6-acec-39ced30ca91d service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Refreshing instance network info cache due to event network-changed-84c13471-a593-4bf7-892c-caafa75901a4. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5de4ce56-0141-4589-bf9c-1cd4820ccdba req-703511fb-23f2-47b6-acec-39ced30ca91d service nova] Acquiring lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5de4ce56-0141-4589-bf9c-1cd4820ccdba req-703511fb-23f2-47b6-acec-39ced30ca91d service nova] Acquired lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-5de4ce56-0141-4589-bf9c-1cd4820ccdba req-703511fb-23f2-47b6-acec-39ced30ca91d service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Refreshing network info cache for port 84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjRMlrDF" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b78b196-5084-4bed-b843-4bf49c5dedd1]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NjRMlrDF'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8028ae-cc4d-449e-b481-c5ded4600e7d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[285f51be-7eff-4d5a-be55-45ba56b67ca8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:12 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f765c5-2558-4410-84a4-7f873d73afef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4, portal: 172.16.0.220,3260]
Nov 27 03:20:13 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6dfa79-b0a0-48b5-a8b9-d059196a941c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ae1901-1a07-4346-9719-ac6255f31f97]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:13 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[214371c0-0890-4d89-809e-ab586cc0d1d1]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjRMlrDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-5de4ce56-0141-4589-bf9c-1cd4820ccdba req-703511fb-23f2-47b6-acec-39ced30ca91d service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Updated VIF entry in instance network info cache for port 84c13471-a593-4bf7-892c-caafa75901a4. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-5de4ce56-0141-4589-bf9c-1cd4820ccdba req-703511fb-23f2-47b6-acec-39ced30ca91d service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Updating instance_info_cache with network_info: [{"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5de4ce56-0141-4589-bf9c-1cd4820ccdba req-703511fb-23f2-47b6-acec-39ced30ca91d service nova] Releasing lock "refresh_cache-78af3b73-bce3-4e4b-b040-eda0d6af7050" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23630343363653836', 'path': '/dev/sdh'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630343363653836', 'path': '/dev/sdh'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lazy-loading 'flavor' on Instance uuid 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:20:14 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:14 user nova-compute[75006]:   <source dev="/dev/sdh"/>
Nov 27 03:20:14 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:14 user nova-compute[75006]:   <serial>68b19fab-ae00-4f1b-8408-63bcac3150e4</serial>
Nov 27 03:20:14 user nova-compute[75006]: </disk>
Nov 27 03:20:14 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] No VIF found with MAC fa:16:3e:05:6e:35, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.objects.instance [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lazy-loading 'flavor' on Instance uuid 8192463c-0589-4a75-97ec-24a5d9149c7f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-db160651-c77f-4127-9b4d-cfa42bf4895d req-714b5220-67d3-4aa5-ac0c-fc483217a610 service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received event network-changed-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-db160651-c77f-4127-9b4d-cfa42bf4895d req-714b5220-67d3-4aa5-ac0c-fc483217a610 service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Refreshing instance network info cache due to event network-changed-7b14e158-9ba1-4ca2-945c-fd79fe5f3452. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db160651-c77f-4127-9b4d-cfa42bf4895d req-714b5220-67d3-4aa5-ac0c-fc483217a610 service nova] Acquiring lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db160651-c77f-4127-9b4d-cfa42bf4895d req-714b5220-67d3-4aa5-ac0c-fc483217a610 service nova] Acquired lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG nova.network.neutron [req-db160651-c77f-4127-9b4d-cfa42bf4895d req-714b5220-67d3-4aa5-ac0c-fc483217a610 service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Refreshing network info cache for port 7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c138d560-1223-45ab-b73d-a627e6361935 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.453s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:15 user nova-compute[75006]: INFO nova.compute.manager [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Attaching volume c6594445-bcf4-4d37-9cc4-0e6aaefeeabb to /dev/vdb
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.utils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ba32bc-5c42-4374-b594-79f7743e43d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe18742-eeff-4855-956c-723a7959e600]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e2e23-915b-4ed1-a4b0-ff1319a58d8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caf378f-11a8-4799-95fa-ef7075852415]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG nova.network.neutron [req-db160651-c77f-4127-9b4d-cfa42bf4895d req-714b5220-67d3-4aa5-ac0c-fc483217a610 service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Updated VIF entry in instance network info cache for port 7b14e158-9ba1-4ca2-945c-fd79fe5f3452. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG nova.network.neutron [req-db160651-c77f-4127-9b4d-cfa42bf4895d req-714b5220-67d3-4aa5-ac0c-fc483217a610 service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Updating instance_info_cache with network_info: [{"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFmHsxVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:15 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:15 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:15 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:15 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[297451d6-cfa4-4004-8e3d-525fba239a9e]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db160651-c77f-4127-9b4d-cfa42bf4895d req-714b5220-67d3-4aa5-ac0c-fc483217a610 service nova] Releasing lock "refresh_cache-8192463c-0589-4a75-97ec-24a5d9149c7f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.utils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Updating existing volume attachment record: 9e112d38-ab25-4f3e-a2fa-3995eda8b4d6 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9779faa5-8b1a-4e6b-b376-9de86651d8bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:20:15 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[96408d4f-66ce-47f5-9814-35dc86d554b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e] added
Nov 27 03:20:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebddc7c-b738-4e6f-98d6-48474443d36d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4c7304-724f-4d28-9d69-58d0110cffc7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFmHsxVv {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFmHsxVv" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7ec1b-6034-460e-9b2e-ae95205bb480]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFmHsxVv'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a155d5ab-ad3e-4047-bf84-c9d65abd1d1d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ae0cc5-65c4-4470-9960-de24d0d0bda0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2538aaa-303a-4675-bf9d-b009086ee811]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e, portal: 172.16.0.220,3260]
Nov 27 03:20:15 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a95813f-7c37-4bf7-9f82-00a720887876]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[64224369-7769-45a8-bc23-d05d2e9ec30f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:15 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e88795f-ca54-4153-8440-ace657e88c60]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:20:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFmHsxVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:16 user nova-compute[75006]: INFO nova.compute.manager [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Detaching volume 68b19fab-ae00-4f1b-8408-63bcac3150e4
Nov 27 03:20:16 user nova-compute[75006]: INFO nova.virt.block_device [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Attempting to driver detach volume 68b19fab-ae00-4f1b-8408-63bcac3150e4 from mountpoint /dev/vdb
Nov 27 03:20:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Attempting to detach device vdb from instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:20:16 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:16 user nova-compute[75006]:   <source dev="/dev/sdh"/>
Nov 27 03:20:16 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:16 user nova-compute[75006]:   <serial>68b19fab-ae00-4f1b-8408-63bcac3150e4</serial>
Nov 27 03:20:16 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:20:16 user nova-compute[75006]: </disk>
Nov 27 03:20:16 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:20:16 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Successfully detached device vdb from instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 from the persistent domain config.
Nov 27 03:20:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:20:16 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:16 user nova-compute[75006]:   <source dev="/dev/sdh"/>
Nov 27 03:20:16 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:16 user nova-compute[75006]:   <serial>68b19fab-ae00-4f1b-8408-63bcac3150e4</serial>
Nov 27 03:20:16 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:20:16 user nova-compute[75006]: </disk>
Nov 27 03:20:16 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23735653230643037', 'path': '/dev/sdi'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735653230643037', 'path': '/dev/sdi'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lazy-loading 'flavor' on Instance uuid 6fb3b75d-a685-4aec-af12-b4c530695174 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:20:16 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:16 user nova-compute[75006]:   <source dev="/dev/sdi"/>
Nov 27 03:20:16 user nova-compute[75006]:   <target dev="sdc" bus="scsi"/>
Nov 27 03:20:16 user nova-compute[75006]:   <serial>9947a8d0-3952-4526-9f4c-544d5d09a11e</serial>
Nov 27 03:20:16 user nova-compute[75006]:   <address type="drive" controller="0" unit="2"/>
Nov 27 03:20:16 user nova-compute[75006]: </disk>
Nov 27 03:20:16 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:20:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] No BDM found with device name sda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] No VIF found with MAC fa:16:3e:57:f6:01, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:20:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b904d094-4ae5-4335-83a3-3a887fff87d2 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.527s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:18 user nova-compute[75006]: INFO nova.compute.manager [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Detaching volume 9947a8d0-3952-4526-9f4c-544d5d09a11e
Nov 27 03:20:18 user nova-compute[75006]: INFO nova.virt.block_device [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Attempting to driver detach volume 9947a8d0-3952-4526-9f4c-544d5d09a11e from mountpoint /dev/sdc
Nov 27 03:20:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Attempting to detach device sdc from instance 6fb3b75d-a685-4aec-af12-b4c530695174 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:20:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:20:18 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:18 user nova-compute[75006]:   <source dev="/dev/sdi"/>
Nov 27 03:20:18 user nova-compute[75006]:   <target dev="sdc" bus="scsi"/>
Nov 27 03:20:18 user nova-compute[75006]:   <serial>9947a8d0-3952-4526-9f4c-544d5d09a11e</serial>
Nov 27 03:20:18 user nova-compute[75006]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 27 03:20:18 user nova-compute[75006]: </disk>
Nov 27 03:20:18 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:20:18 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Successfully detached device sdc from instance 6fb3b75d-a685-4aec-af12-b4c530695174 from the persistent domain config.
Nov 27 03:20:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 6fb3b75d-a685-4aec-af12-b4c530695174 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:20:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:20:18 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:18 user nova-compute[75006]:   <source dev="/dev/sdi"/>
Nov 27 03:20:18 user nova-compute[75006]:   <target dev="sdc" bus="scsi"/>
Nov 27 03:20:18 user nova-compute[75006]:   <serial>9947a8d0-3952-4526-9f4c-544d5d09a11e</serial>
Nov 27 03:20:18 user nova-compute[75006]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 27 03:20:18 user nova-compute[75006]: </disk>
Nov 27 03:20:18 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:20:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 6fb3b75d-a685-4aec-af12-b4c530695174 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-6119853d-005a-4814-9563-d6f02b0c5396 req-3fc6cdf6-394e-4c2d-9b38-9d49387d7063 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-changed-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-6119853d-005a-4814-9563-d6f02b0c5396 req-3fc6cdf6-394e-4c2d-9b38-9d49387d7063 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Refreshing instance network info cache due to event network-changed-1856fd0c-42fd-44e2-b937-2bf7564d7f13. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6119853d-005a-4814-9563-d6f02b0c5396 req-3fc6cdf6-394e-4c2d-9b38-9d49387d7063 service nova] Acquiring lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6119853d-005a-4814-9563-d6f02b0c5396 req-3fc6cdf6-394e-4c2d-9b38-9d49387d7063 service nova] Acquired lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-6119853d-005a-4814-9563-d6f02b0c5396 req-3fc6cdf6-394e-4c2d-9b38-9d49387d7063 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Refreshing network info cache for port 1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-6119853d-005a-4814-9563-d6f02b0c5396 req-3fc6cdf6-394e-4c2d-9b38-9d49387d7063 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Updated VIF entry in instance network info cache for port 1856fd0c-42fd-44e2-b937-2bf7564d7f13. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-6119853d-005a-4814-9563-d6f02b0c5396 req-3fc6cdf6-394e-4c2d-9b38-9d49387d7063 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Updating instance_info_cache with network_info: [{"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6119853d-005a-4814-9563-d6f02b0c5396 req-3fc6cdf6-394e-4c2d-9b38-9d49387d7063 service nova] Releasing lock "refresh_cache-503a960f-c3f6-4b8f-af89-7796916be32c" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:19 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:19 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:19 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:20:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[681e1d22-052d-4b6d-8a35-917c1ef9dc18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:20:19 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadeb1fb-7f45-45aa-a51e-603d84882479]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833] added
Nov 27 03:20:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e415f2-0b8a-4474-960e-4fa94f88a0ee]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[63623d6b-7ae2-48ad-b44f-5c3b685c86a6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbzHwmhW {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbzHwmhW" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[94edd23c-f84d-4cbf-90b0-8b0fdfb74585]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jbzHwmhW'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9626e7b-a14e-4f87-af1f-9557eceaa5af]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[acddb8ff-1cdc-4002-8675-c214b5d65349]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd966c3-b460-46a1-8c33-49eccf59b8dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260]
Nov 27 03:20:20 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5da2e8-af38-413d-a7fa-258273e6a66c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd569e6-f75e-43df-a2c2-f6ce9f5e14a4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:20 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3f69a-bc5e-4247-aac2-0eb579af7e29]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:20:20 user nova-compute[75006]: INFO nova.compute.manager [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Rebuilding instance
Nov 27 03:20:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-634c4be2-9dc4-41f0-9084-2faf3291d06e req-97def013-b22f-4890-9e6f-97ebd297c33a service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-unplugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-634c4be2-9dc4-41f0-9084-2faf3291d06e req-97def013-b22f-4890-9e6f-97ebd297c33a service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-634c4be2-9dc4-41f0-9084-2faf3291d06e req-97def013-b22f-4890-9e6f-97ebd297c33a service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-634c4be2-9dc4-41f0-9084-2faf3291d06e req-97def013-b22f-4890-9e6f-97ebd297c33a service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-634c4be2-9dc4-41f0-9084-2faf3291d06e req-97def013-b22f-4890-9e6f-97ebd297c33a service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] No waiting events found dispatching network-vif-unplugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:20 user nova-compute[75006]: WARNING nova.compute.manager [req-634c4be2-9dc4-41f0-9084-2faf3291d06e req-97def013-b22f-4890-9e6f-97ebd297c33a service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received unexpected event network-vif-unplugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 for instance with vm_state active and task_state rebuilding.
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26135643336316330', 'path': '/dev/sdj'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135643336316330', 'path': '/dev/sdj'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.objects.instance [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lazy-loading 'flavor' on Instance uuid 78af3b73-bce3-4e4b-b040-eda0d6af7050 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:20:21 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:21 user nova-compute[75006]:   <source dev="/dev/sdj"/>
Nov 27 03:20:21 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:21 user nova-compute[75006]:   <serial>fe428d41-58e9-4036-a448-50de57a0b833</serial>
Nov 27 03:20:21 user nova-compute[75006]: </disk>
Nov 27 03:20:21 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:20:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance destroyed successfully.
Nov 27 03:20:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance destroyed successfully.
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215776583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1739552079',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEwjlY0CoUcygTkC5MyCYRqbOE6ERSsD3pzuc1AA/39Q08Ghvl6YSDYF0crP8xc6jrODLO9Q5HWNs2BEYtVvjp1IiwJwNqfALKa03qefDLZ2IO8YLyjexGBUJf2j1WyOg==',key_name='tempest-keypair-1820861676',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f859896de4a04f35a385b771412f684a',ramdisk_id='',reservation_id='r-7qq7bj0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-647617165',owner_user_name='tempest-ServerActionsV293TestJSON-647617165-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:20:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693d59e66f9e41478ce9a1d199f7633d',uuid=503a960f-c3f6-4b8f-af89-7796916be32c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converting VIF {"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_vif [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1856fd0c-42, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff5421dd-ced6-4097-8f4d-193dc10e0b7e) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:21 user nova-compute[75006]: INFO os_vif [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42')
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:21 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d94b55b-8b28-4527-9211-202456609ddf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:21 user nova-compute[75006]: No targets found.
Nov 27 03:20:21 user nova-compute[75006]: iSNS:
Nov 27 03:20:21 user nova-compute[75006]: No targets found.
Nov 27 03:20:21 user nova-compute[75006]: STATIC:
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:21 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:21 user nova-compute[75006]: No targets found.
Nov 27 03:20:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:21 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:21 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6071e9-8716-4d62-97b8-37fa1d8418d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca8b4a6-04eb-4040-945a-4f71d0d407b4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:21 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd44516ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4790b9f3-eff2-4445-b502-45add483cb57]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e963713-ebf7-49ac-a2c9-c43ceff7e801]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2ac690-f6b3-40dc-b767-2bf527d4f42b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df47cf8-d3f2-470c-9b79-88c1ff731340]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd8569501-5c25f2bf518d7875', '/dev/disk/by-id/scsi-23563323566326266', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d8569501') {{(pid=85775) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f27d07-9d11-4cd1-bc83-9d536d7e4c03]: (4, None) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ea657-f520-4943-a3e6-92ab5fe3b93b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b2b8d3-6c27-4e36-bb8b-7aa401b528e3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260]
Nov 27 03:20:21 user nova-compute[75006]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] No VIF found with MAC fa:16:3e:29:8f:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc550cb-155c-4023-861e-595f837ba099]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] <== disconnect_volume: return (387ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Deleting instance files /opt/stack/data/nova/instances/503a960f-c3f6-4b8f-af89-7796916be32c_del
Nov 27 03:20:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Deletion of /opt/stack/data/nova/instances/503a960f-c3f6-4b8f-af89-7796916be32c_del complete
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-da8026af-4d88-439f-94e7-9e6d2879fe02 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.825s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:22 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 503a960f-c3f6-4b8f-af89-7796916be32c could not be found.
Nov 27 03:20:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:22 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef490ea6-4032-4c71-8696-d5f0a8ffbc64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:22 user nova-compute[75006]: No targets found.
Nov 27 03:20:22 user nova-compute[75006]: iSNS:
Nov 27 03:20:22 user nova-compute[75006]: No targets found.
Nov 27 03:20:22 user nova-compute[75006]: STATIC:
Nov 27 03:20:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed
Nov 27 03:20:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833
Nov 27 03:20:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e
Nov 27 03:20:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a
Nov 27 03:20:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4
Nov 27 03:20:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:22 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:22 user nova-compute[75006]: No targets found.
Nov 27 03:20:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:22 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:22 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[098df553-f198-4b34-b367-8da4976e072c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[34406a19-703a-4e9d-b2e8-ee60493a8bd4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:22 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4246aa0e0>, {}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Disconnecting from: [] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] <== disconnect_volume: return (91ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlmBvDQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:22 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:22 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:22 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c8fefc3-4446-407a-b910-e773f90d82aa req-df76ee04-4c42-4abe-8a60-3466bf86f736 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c8fefc3-4446-407a-b910-e773f90d82aa req-df76ee04-4c42-4abe-8a60-3466bf86f736 service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c8fefc3-4446-407a-b910-e773f90d82aa req-df76ee04-4c42-4abe-8a60-3466bf86f736 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c8fefc3-4446-407a-b910-e773f90d82aa req-df76ee04-4c42-4abe-8a60-3466bf86f736 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c8fefc3-4446-407a-b910-e773f90d82aa req-df76ee04-4c42-4abe-8a60-3466bf86f736 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] No waiting events found dispatching network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:22 user nova-compute[75006]: WARNING nova.compute.manager [req-0c8fefc3-4446-407a-b910-e773f90d82aa req-df76ee04-4c42-4abe-8a60-3466bf86f736 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received unexpected event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 for instance with vm_state active and task_state rebuilding.
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b8e0b-bd56-48f6-ba82-00fc26d64874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:20:22 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[406c8656-74bb-46bb-9a57-b2647c04fca0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb] added
Nov 27 03:20:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ca6617-24fe-4d11-a83d-936d027c601c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edf643a-2605-4071-97ec-4255520ada6b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlmBvDQP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FlmBvDQP" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fba4d0-453c-4229-a005-1ddafa8448b8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FlmBvDQP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2278560-bd17-4a7b-bc5d-5d220a38545a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Preparing to wait for external event volume-reimaged-13409c5f-0143-40b9-92f9-42dea666781d {{(pid=75006) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[78195dd1-ca56-45f6-ab83-0393968ca972]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f76964-9479-42e8-af75-23b2e179eb85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb, portal: 172.16.0.220,3260]
Nov 27 03:20:23 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:23 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[84893823-caeb-40f9-90f0-34f8628022ec]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0bf963-8324-4062-917e-46e7a3d10793]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:23 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:23 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12cf457-f496-448c-8d66-2e9ca94620ef]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlmBvDQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.utils [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be12405-4d60-4865-9180-5571edb94b86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebebe299-1296-4556-9782-7ce4b2b5dd90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[058401ba-e2c3-4bcd-b707-0d3a37953e2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d00814-71fb-4e51-8465-e808ae6494fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:23 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:20:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b8ca23-a403-457c-9b59-b26d5836e199]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:20:23 user nova-compute[75006]: DEBUG os_brick.utils [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:23 user nova-compute[75006]: INFO nova.compute.manager [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Swapping volume fe428d41-58e9-4036-a448-50de57a0b833 for 52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '26361623637306130', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361623637306130', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:20:24 user nova-compute[75006]: DEBUG nova.objects.instance [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lazy-loading 'flavor' on Instance uuid 8192463c-0589-4a75-97ec-24a5d9149c7f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] attach device xml: <disk type="block" device="disk">
Nov 27 03:20:24 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:24 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:20:24 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:24 user nova-compute[75006]:   <serial>c6594445-bcf4-4d37-9cc4-0e6aaefeeabb</serial>
Nov 27 03:20:24 user nova-compute[75006]: </disk>
Nov 27 03:20:24 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:20:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] No VIF found with MAC fa:16:3e:fd:57:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:20:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-709b6bc1-04a1-4b33-ada0-af83076a6377 tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.875s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7226e1d5-a645-4617-a502-7f21101aada7 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] volume_snapshot_create: create_info: {'snapshot_id': 'b7713f74-c33a-4ee7-9038-f2cb0c9a8d91', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75006) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 27 03:20:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7226e1d5-a645-4617-a502-7f21101aada7 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] snap xml: <domainsnapshot>
Nov 27 03:20:26 user nova-compute[75006]:   <disks>
Nov 27 03:20:26 user nova-compute[75006]:     <disk name="/dev/sdb" snapshot="external" type="file">
Nov 27 03:20:26 user nova-compute[75006]:       <source file="/dev/new_file"/>
Nov 27 03:20:26 user nova-compute[75006]:     </disk>
Nov 27 03:20:26 user nova-compute[75006]:     <disk name="vda" snapshot="no"/>
Nov 27 03:20:26 user nova-compute[75006]:   </disks>
Nov 27 03:20:26 user nova-compute[75006]: </domainsnapshot>
Nov 27 03:20:26 user nova-compute[75006]:  {{(pid=75006) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 27 03:20:26 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7226e1d5-a645-4617-a502-7f21101aada7 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] Lazy-loading 'system_metadata' on Instance uuid 8192463c-0589-4a75-97ec-24a5d9149c7f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:26 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7226e1d5-a645-4617-a502-7f21101aada7 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 03:20:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-993f9ada-5c44-474b-ae33-4c8df28fec95 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] volume_snapshot_delete: delete_info: {'volume_id': 'c6594445-bcf4-4d37-9cc4-0e6aaefeeabb'} {{(pid=75006) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [None req-993f9ada-5c44-474b-ae33-4c8df28fec95 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     if delete_info['type'] != 'qcow2':
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] KeyError: 'type'
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [None req-7226e1d5-a645-4617-a502-7f21101aada7 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     rv = execute(f, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     six.reraise(c, e, tb)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     raise value
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     rv = meth(*args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [None req-7226e1d5-a645-4617-a502-7f21101aada7 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     self._volume_snapshot_create(context, instance, guest,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     rv = execute(f, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     six.reraise(c, e, tb)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     raise value
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     rv = meth(*args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [None req-993f9ada-5c44-474b-ae33-4c8df28fec95 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f5b06c62-1dee-4022-ab04-fb660aaaa9d8)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server [None req-993f9ada-5c44-474b-ae33-4c8df28fec95 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] Exception during message handling: KeyError: 'type'
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver [None req-7226e1d5-a645-4617-a502-7f21101aada7 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b7713f74-c33a-4ee7-9038-f2cb0c9a8d91 could not be found.
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     raise value
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b7713f74-c33a-4ee7-9038-f2cb0c9a8d91 could not be found. (HTTP 404) (Request-ID: req-523f5690-892f-424d-beaf-e9be673c639a)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b7713f74-c33a-4ee7-9038-f2cb0c9a8d91 could not be found.
Nov 27 03:20:26 user nova-compute[75006]: ERROR nova.virt.libvirt.driver 
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server [None req-7226e1d5-a645-4617-a502-7f21101aada7 tempest-VolumesAssistedSnapshotsTest-1738873439 tempest-VolumesAssistedSnapshotsTest-1738873439-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     raise value
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 03:20:26 user nova-compute[75006]: ERROR oslo_messaging.rpc.server 
Nov 27 03:20:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:26 user nova-compute[75006]: INFO nova.compute.manager [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Detaching volume c6594445-bcf4-4d37-9cc4-0e6aaefeeabb
Nov 27 03:20:26 user nova-compute[75006]: INFO nova.virt.block_device [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Attempting to driver detach volume c6594445-bcf4-4d37-9cc4-0e6aaefeeabb from mountpoint /dev/vdb
Nov 27 03:20:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Attempting to detach device vdb from instance 8192463c-0589-4a75-97ec-24a5d9149c7f from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:20:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] detach device xml: <disk type="block" device="disk">
Nov 27 03:20:26 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:26 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:20:26 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:26 user nova-compute[75006]:   <serial>c6594445-bcf4-4d37-9cc4-0e6aaefeeabb</serial>
Nov 27 03:20:26 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:20:26 user nova-compute[75006]: </disk>
Nov 27 03:20:26 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:20:26 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Successfully detached device vdb from instance 8192463c-0589-4a75-97ec-24a5d9149c7f from the persistent domain config.
Nov 27 03:20:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8192463c-0589-4a75-97ec-24a5d9149c7f from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:20:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] detach device xml: <disk type="block" device="disk">
Nov 27 03:20:26 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:26 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:20:26 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:26 user nova-compute[75006]:   <serial>c6594445-bcf4-4d37-9cc4-0e6aaefeeabb</serial>
Nov 27 03:20:26 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:20:26 user nova-compute[75006]: </disk>
Nov 27 03:20:26 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:20:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8192463c-0589-4a75-97ec-24a5d9149c7f {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:20:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdFgsKvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78af3b73-bce3-4e4b-b040-eda0d6af7050', 'attached_at': '', 'detached_at': '', 'volume_id': '52f1cff6-8764-4ef9-a924-d989a329bdcf', 'serial': '52f1cff6-8764-4ef9-a924-d989a329bdcf'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '78af3b73-bce3-4e4b-b040-eda0d6af7050', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe428d41-58e9-4036-a448-50de57a0b833', 'serial'} {{(pid=75006) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdFgsKvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:31 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:31 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:31 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa37dd8-abc1-45c9-bd2a-9a6f900c86b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:20:31 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a93f9e-e97b-4694-879b-dafdf37a12e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf] added
Nov 27 03:20:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[03000241-683e-4010-bc24-e36a14823b68]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd92b70-6df7-40e3-8177-d9ada49d2d95]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdFgsKvc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdFgsKvc" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b17605-ee16-4c97-b564-088134f3a175]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TdFgsKvc'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cfa5c1-e461-4966-9552-ac585034cfd8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d3c183-8879-4625-8aa9-87b8b0dfb7fc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d412933d-d882-4d9b-8f8a-eb71ae98dd4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf, portal: 172.16.0.220,3260]
Nov 27 03:20:31 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0367d42c-8f6f-477c-94a2-f4c5d3fef0b1]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[58408565-5376-45f9-a0e8-43e8323ba9d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:31 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] HCTL ('43', '-', '-', 0) found on session 14 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6671e471-8215-448a-8697-a9a7b344615f]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:20:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdFgsKvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:20:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26638303334356663', 'path': '/dev/sdl'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638303334356663', 'path': '/dev/sdl'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:20:32 user nova-compute[75006]: DEBUG nova.objects.instance [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lazy-loading 'flavor' on Instance uuid 78af3b73-bce3-4e4b-b040-eda0d6af7050 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 190840832 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 374341632 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 525336576 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 661651456 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 761266176 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 855638016 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 960495616 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:36 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 is timed out.
Nov 27 03:20:36 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Successfully detached device vdb from instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 from the live domain config.
Nov 27 03:20:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjRMlrDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:36 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5047a0df-b574-468a-a1ff-fa742db1fc44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:36 user nova-compute[75006]: No targets found.
Nov 27 03:20:36 user nova-compute[75006]: iSNS:
Nov 27 03:20:36 user nova-compute[75006]: No targets found.
Nov 27 03:20:36 user nova-compute[75006]: STATIC:
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:36 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:36 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:36 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:36 user nova-compute[75006]: No targets found.
Nov 27 03:20:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:36 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:36 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca2f27d-e454-4d63-90cd-a7ce6b3da729]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd837ebe-ceb1-400e-81f4-4109d06d758d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:36 user nova-compute[75006]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 (non-flash)
Nov 27 03:20:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd42429c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4'): ({'sdh'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Removing single pathed devices sdh {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d2b67c-f651-4b5b-8a9f-2bc2e243f61f]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cfc199-0105-4553-bb29-eb2f08181a87]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Flushing IO for device /dev/sdh {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f96f690-0f6f-46fb-a764-5c457aa003e6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 1018167296 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f570f-c2b2-4950-bd3c-05915120a1a8]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] SCSI volumes sdh have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b22361b-8aa4-45f4-806a-e0398a1b7627]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fad4bb-6715-4400-87b9-5ba955421557]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4, portal: 172.16.0.220,3260]
Nov 27 03:20:37 user nova-compute[75006]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b19fab-ae00-4f1b-8408-63bcac3150e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb252ffd-0286-4641-a755-9c583a9e228b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] <== disconnect_volume: return (454ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:37 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a505ad2-f2fe-4e3f-9640-75b31fbb4b39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:37 user nova-compute[75006]: No targets found.
Nov 27 03:20:37 user nova-compute[75006]: iSNS:
Nov 27 03:20:37 user nova-compute[75006]: No targets found.
Nov 27 03:20:37 user nova-compute[75006]: STATIC:
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:37 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:37 user nova-compute[75006]: No targets found.
Nov 27 03:20:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:37 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:37 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f7832-c095-425a-aed7-51eaea20f7ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa7c048-0f58-418f-a7a0-659d876d46ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:37 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4482e3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833'): ({'sdj'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Removing single pathed devices sdj {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ebc33d-0e0b-486e-854b-0e947b1b71b9]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e178720-9270-4f53-9415-823eacff4708]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Flushing IO for device /dev/sdj {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dd6227-c73d-4637-aaa7-ee8f6ca2f251]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.041s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c97a56-0447-453a-afdd-9fb40f918faa]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] SCSI volumes sdj have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f71058-8f35-440c-9288-1c85f248f594]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa7efd-4a30-4b38-9061-513d44dd2671]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260]
Nov 27 03:20:37 user nova-compute[75006]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c115d-1650-4a4e-b6e2-6e5b25f93fce]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] <== disconnect_volume: return (342ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdFgsKvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '78af3b73-bce3-4e4b-b040-eda0d6af7050', 'attached_at': '', 'detached_at': '', 'volume_id': '52f1cff6-8764-4ef9-a924-d989a329bdcf', 'serial'} {{(pid=75006) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] swap_volume: removing Cinder connection for volume fe428d41-58e9-4036-a448-50de57a0b833 {{(pid=75006) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG nova.objects.instance [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lazy-loading 'flavor' on Instance uuid 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-669cc3cb-6841-4589-9426-5eb2ea72455a tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.964s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:38 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 6fb3b75d-a685-4aec-af12-b4c530695174 is timed out.
Nov 27 03:20:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Successfully detached device sdc from instance 6fb3b75d-a685-4aec-af12-b4c530695174 from the live domain config.
Nov 27 03:20:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFmHsxVv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:38 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb5f94e-33f0-4430-b85e-09d38055e4f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:38 user nova-compute[75006]: No targets found.
Nov 27 03:20:38 user nova-compute[75006]: iSNS:
Nov 27 03:20:38 user nova-compute[75006]: No targets found.
Nov 27 03:20:38 user nova-compute[75006]: STATIC:
Nov 27 03:20:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed
Nov 27 03:20:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e
Nov 27 03:20:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a
Nov 27 03:20:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb
Nov 27 03:20:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:38 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:38 user nova-compute[75006]: No targets found.
Nov 27 03:20:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:38 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:38 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[093fcc99-25dd-4eb3-b96e-b133b108af19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4870e-3169-4dc0-8298-81eb64ff41a0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:38 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd44516f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e'): ({'sdi'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Removing single pathed devices sdi {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6721e93-39e7-4d74-bfb5-45f202cfc1c9]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[124615fc-7754-4ac9-a7a6-e2f5acfbec2b]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Flushing IO for device /dev/sdi {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5312524f-d699-4478-affc-d40841d3d8c0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e6fdd9-1db5-4d84-8524-6f8743425c8c]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] SCSI volumes sdi have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf200b-fded-4b0f-97d4-e79bbfe9b03c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd22085-188e-4375-9a87-ee2b2e6938e5]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e, portal: 172.16.0.220,3260]
Nov 27 03:20:38 user nova-compute[75006]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9947a8d0-3952-4526-9f4c-544d5d09a11e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ba0c7-20c6-4ad3-8620-2f9230177f3f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] <== disconnect_volume: return (354ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] swap_volume: Updating volume fe428d41-58e9-4036-a448-50de57a0b833 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TdFgsKvc", "auth_password": "9ASRXqUiTzPCdO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "52f1cff6-8764-4ef9-a924-d989a329bdcf"}, "status": "reserved", "instance": "78af3b73-bce3-4e4b-b040-eda0d6af7050", "attached_at": "", "detached_at": "", "volume_id": "52f1cff6-8764-4ef9-a924-d989a329bdcf", "serial": "52f1cff6-8764-4ef9-a924-d989a329bdcf"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '52f1cff6-8764-4ef9-a924-d989a329bdcf', 'no_device': None, 'attachment_id': '7f518de6-f59c-4ab4-b9a4-8a458e7a3537'} {{(pid=75006) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-182c5203-43ab-404d-af4a-3f14b6279ff2 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.523s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-c60d75ee-a077-4bde-8926-74df7d70b9a3 req-d5952671-df68-4157-81b4-cf23a1dbef42 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-changed-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-c60d75ee-a077-4bde-8926-74df7d70b9a3 req-d5952671-df68-4157-81b4-cf23a1dbef42 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing instance network info cache due to event network-changed-7c0690b6-99ad-420f-a371-9463c3d9e2c5. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c60d75ee-a077-4bde-8926-74df7d70b9a3 req-d5952671-df68-4157-81b4-cf23a1dbef42 service nova] Acquiring lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c60d75ee-a077-4bde-8926-74df7d70b9a3 req-d5952671-df68-4157-81b4-cf23a1dbef42 service nova] Acquired lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG nova.network.neutron [req-c60d75ee-a077-4bde-8926-74df7d70b9a3 req-d5952671-df68-4157-81b4-cf23a1dbef42 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Refreshing network info cache for port 7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-60cdabc2-9461-40a3-a670-02930d730dbc req-177ed82f-ebca-4643-b570-87da64f3f2b5 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event volume-reimaged-13409c5f-0143-40b9-92f9-42dea666781d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-60cdabc2-9461-40a3-a670-02930d730dbc req-177ed82f-ebca-4643-b570-87da64f3f2b5 service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-60cdabc2-9461-40a3-a670-02930d730dbc req-177ed82f-ebca-4643-b570-87da64f3f2b5 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-60cdabc2-9461-40a3-a670-02930d730dbc req-177ed82f-ebca-4643-b570-87da64f3f2b5 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-60cdabc2-9461-40a3-a670-02930d730dbc req-177ed82f-ebca-4643-b570-87da64f3f2b5 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Processing event volume-reimaged-13409c5f-0143-40b9-92f9-42dea666781d {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 27 03:20:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:20:39 user nova-compute[75006]: INFO nova.virt.block_device [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Booting with volume 13409c5f-0143-40b9-92f9-42dea666781d at /dev/vda
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.utils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7ebea5-41f2-484e-940e-5fc63e2dc62e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d39977-29f3-4d43-85d6-28ce339e3d52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e699808a-5907-4de5-82af-cc8fc8a14f6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[344e960e-0a97-4bcc-991c-b74c1af4981b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG nova.objects.instance [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lazy-loading 'flavor' on Instance uuid 6fb3b75d-a685-4aec-af12-b4c530695174 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:40 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ce1aef-fbe5-4a24-8a58-de52cd4de79a]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.utils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Updating existing volume attachment record: 3851bdd2-c550-41b6-b9e4-9b4ed8ad09ba {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdfdb54e-7b51-4abc-b02f-146f4d7374dd tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.209s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.utils [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b57c3c-1317-45f4-a756-99ac9866212f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2ccb81-ff3e-4c4e-825d-f2d68e85c9aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9231ed-53db-475c-9af2-c49faec610d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa92da-eaf1-4139-a972-6d78c83c9642]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:20:40 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d807f1e6-0daf-4af7-8b28-ff49fcf80672]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG os_brick.utils [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:40 user nova-compute[75006]: INFO nova.compute.manager [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Swapping volume 52f1cff6-8764-4ef9-a924-d989a329bdcf for fe428d41-58e9-4036-a448-50de57a0b833
Nov 27 03:20:40 user nova-compute[75006]: DEBUG nova.network.neutron [req-c60d75ee-a077-4bde-8926-74df7d70b9a3 req-d5952671-df68-4157-81b4-cf23a1dbef42 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updated VIF entry in instance network info cache for port 7c0690b6-99ad-420f-a371-9463c3d9e2c5. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG nova.network.neutron [req-c60d75ee-a077-4bde-8926-74df7d70b9a3 req-d5952671-df68-4157-81b4-cf23a1dbef42 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [{"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c60d75ee-a077-4bde-8926-74df7d70b9a3 req-d5952671-df68-4157-81b4-cf23a1dbef42 service nova] Releasing lock "refresh_cache-fc95fb16-d2f5-4f45-ac78-bcd060f585a8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:41 user nova-compute[75006]: INFO nova.compute.manager [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Terminating instance
Nov 27 03:20:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-dc4f9ee5-aca1-477d-9079-de5b3f72fa67 req-f6f89134-a7e1-448c-bcd9-7a36e0a62fbd service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received event network-vif-unplugged-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-dc4f9ee5-aca1-477d-9079-de5b3f72fa67 req-f6f89134-a7e1-448c-bcd9-7a36e0a62fbd service nova] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-dc4f9ee5-aca1-477d-9079-de5b3f72fa67 req-f6f89134-a7e1-448c-bcd9-7a36e0a62fbd service nova] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-dc4f9ee5-aca1-477d-9079-de5b3f72fa67 req-f6f89134-a7e1-448c-bcd9-7a36e0a62fbd service nova] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-dc4f9ee5-aca1-477d-9079-de5b3f72fa67 req-f6f89134-a7e1-448c-bcd9-7a36e0a62fbd service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] No waiting events found dispatching network-vif-unplugged-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-dc4f9ee5-aca1-477d-9079-de5b3f72fa67 req-f6f89134-a7e1-448c-bcd9-7a36e0a62fbd service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received event network-vif-unplugged-587db899-908f-449e-917e-5becb867f54d for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Instance destroyed successfully.
Nov 27 03:20:41 user nova-compute[75006]: DEBUG nova.objects.instance [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lazy-loading 'resources' on Instance uuid 6fb3b75d-a685-4aec-af12-b4c530695174 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1544459975',display_name='tempest-AttachSCSIVolumeTestJSON-server-1544459975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1544459975',id=7,image_ref='6eba436a-817f-4b06-b7c1-03ab99ad8edf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObyERo+vGlsStXLA6JQ2lCgKIh65H6F8S4tz6h42FxXDUbugsZMbgzndgrDjP18Pu23ri0GDXL8lsFKrvCoipanIyLH8xJdEZWbK9B+fwWVMQ2kQ+6OCAJ27CiJPx7DMQ==',key_name='tempest-keypair-446293778',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfbd2f7743454258944029eb9462d5fc',ramdisk_id='',reservation_id='r-61c7zphg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6eba436a-817f-4b06-b7c1-03ab99ad8edf',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1280651358',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1280651358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:18:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56b832c38c0462bb15023d0d4e70084',uuid=6fb3b75d-a685-4aec-af12-b4c530695174,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Converting VIF {"id": "587db899-908f-449e-917e-5becb867f54d", "address": "fa:16:3e:57:f6:01", "network": {"id": "f080d0ff-8548-429b-9ea2-b9717a1aa5ef", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-664008129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfbd2f7743454258944029eb9462d5fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap587db899-90", "ovs_interfaceid": "587db899-908f-449e-917e-5becb867f54d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:f6:01,bridge_name='br-int',has_traffic_filtering=True,id=587db899-908f-449e-917e-5becb867f54d,network=Network(f080d0ff-8548-429b-9ea2-b9717a1aa5ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587db899-90') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG os_vif [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:f6:01,bridge_name='br-int',has_traffic_filtering=True,id=587db899-908f-449e-917e-5becb867f54d,network=Network(f080d0ff-8548-429b-9ea2-b9717a1aa5ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587db899-90') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap587db899-90, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4f1c6e8-f9c0-4209-86e6-60c7402fde00) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:41 user nova-compute[75006]: INFO os_vif [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:f6:01,bridge_name='br-int',has_traffic_filtering=True,id=587db899-908f-449e-917e-5becb867f54d,network=Network(f080d0ff-8548-429b-9ea2-b9717a1aa5ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap587db899-90')
Nov 27 03:20:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Deleting instance files /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174_del
Nov 27 03:20:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Deletion of /opt/stack/data/nova/instances/6fb3b75d-a685-4aec-af12-b4c530695174_del complete
Nov 27 03:20:42 user nova-compute[75006]: INFO nova.compute.manager [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 27 03:20:42 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:20:42 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:20:42 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:20:42 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:42 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:42 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-80ca28d0-3a22-44fb-8c7b-5d46e6666fd0 req-2a8181f5-ad33-428f-b1cf-72c3163a4e9d service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received event network-vif-deleted-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:43 user nova-compute[75006]: INFO nova.compute.manager [req-80ca28d0-3a22-44fb-8c7b-5d46e6666fd0 req-2a8181f5-ad33-428f-b1cf-72c3163a4e9d service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Neutron deleted interface 587db899-908f-449e-917e-5becb867f54d; detaching it from the instance and deleting it from the info cache
Nov 27 03:20:43 user nova-compute[75006]: DEBUG nova.network.neutron [req-80ca28d0-3a22-44fb-8c7b-5d46e6666fd0 req-2a8181f5-ad33-428f-b1cf-72c3163a4e9d service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:43 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Took 1.34 seconds to deallocate network for instance.
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:43 user nova-compute[75006]: INFO nova.compute.manager [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Terminating instance
Nov 27 03:20:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-80ca28d0-3a22-44fb-8c7b-5d46e6666fd0 req-2a8181f5-ad33-428f-b1cf-72c3163a4e9d service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Detach interface failed, port_id=587db899-908f-449e-917e-5becb867f54d, reason: Instance 6fb3b75d-a685-4aec-af12-b4c530695174 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-ea6b5dfb-d003-4267-ac64-ac3057b99762 req-b8412e6e-821d-4d69-927d-d4640b998231 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received event network-vif-plugged-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ea6b5dfb-d003-4267-ac64-ac3057b99762 req-b8412e6e-821d-4d69-927d-d4640b998231 service nova] Acquiring lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ea6b5dfb-d003-4267-ac64-ac3057b99762 req-b8412e6e-821d-4d69-927d-d4640b998231 service nova] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ea6b5dfb-d003-4267-ac64-ac3057b99762 req-b8412e6e-821d-4d69-927d-d4640b998231 service nova] Lock "6fb3b75d-a685-4aec-af12-b4c530695174-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-ea6b5dfb-d003-4267-ac64-ac3057b99762 req-b8412e6e-821d-4d69-927d-d4640b998231 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] No waiting events found dispatching network-vif-plugged-587db899-908f-449e-917e-5becb867f54d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:43 user nova-compute[75006]: WARNING nova.compute.manager [req-ea6b5dfb-d003-4267-ac64-ac3057b99762 req-b8412e6e-821d-4d69-927d-d4640b998231 service nova] [instance: 6fb3b75d-a685-4aec-af12-b4c530695174] Received unexpected event network-vif-plugged-587db899-908f-449e-917e-5becb867f54d for instance with vm_state active and task_state deleting.
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-b3c57e7c-4552-4eee-aba0-90fb7939f97e req-7418df66-8fbf-402e-a746-3e250e9f76f7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b3c57e7c-4552-4eee-aba0-90fb7939f97e req-7418df66-8fbf-402e-a746-3e250e9f76f7 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b3c57e7c-4552-4eee-aba0-90fb7939f97e req-7418df66-8fbf-402e-a746-3e250e9f76f7 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b3c57e7c-4552-4eee-aba0-90fb7939f97e req-7418df66-8fbf-402e-a746-3e250e9f76f7 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-b3c57e7c-4552-4eee-aba0-90fb7939f97e req-7418df66-8fbf-402e-a746-3e250e9f76f7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-unplugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-b3c57e7c-4552-4eee-aba0-90fb7939f97e req-7418df66-8fbf-402e-a746-3e250e9f76f7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.829s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Deleted allocations for instance 6fb3b75d-a685-4aec-af12-b4c530695174
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2eeb4b19-c37c-49cf-91c3-53aadb196a04 tempest-AttachSCSIVolumeTestJSON-1280651358 tempest-AttachSCSIVolumeTestJSON-1280651358-project-member] Lock "6fb3b75d-a685-4aec-af12-b4c530695174" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.568s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Instance destroyed successfully.
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.objects.instance [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lazy-loading 'resources' on Instance uuid fc95fb16-d2f5-4f45-ac78-bcd060f585a8 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d7:af,bridge_name='br-int',has_traffic_filtering=True,id=7c0690b6-99ad-420f-a371-9463c3d9e2c5,network=Network(6be19388-221e-4a81-a5b5-c5b1c235bb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0690b6-99') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d7:af,bridge_name='br-int',has_traffic_filtering=True,id=7c0690b6-99ad-420f-a371-9463c3d9e2c5,network=Network(6be19388-221e-4a81-a5b5-c5b1c235bb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0690b6-99') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-unplugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:45 user nova-compute[75006]: WARNING nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-37d5162f-6cf7-47a6-8d10-98d4a63b0706 for instance with vm_state active and task_state deleting.
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-unplugged-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-08fd5394-cd17-4456-a310-e65e34282584 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:45 user nova-compute[75006]: WARNING nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-08fd5394-cd17-4456-a310-e65e34282584 for instance with vm_state active and task_state deleting.
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-unplugged-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-e5134743-9a4e-4508-8ff2-9fb481463a8a for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:45 user nova-compute[75006]: WARNING nova.compute.manager [req-549c50f8-54f8-4f71-912d-ec24e812ef69 req-9b854909-ccc4-4afd-badd-1ab9f286da23 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-e5134743-9a4e-4508-8ff2-9fb481463a8a for instance with vm_state active and task_state deleting.
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c0690b6-99, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c9e6848-ccbe-441c-a941-2c8ca4d49685) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-unplugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:45 user nova-compute[75006]: WARNING nova.compute.manager [req-35c425ab-2c02-46af-a63f-2c5ec7ee50d5 req-3cbbe437-71fa-4a24-bccc-c035a03c0a1a service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-ef72d3cb-a396-4554-b801-ddfc0c017b66 for instance with vm_state active and task_state deleting.
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: INFO os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:d7:af,bridge_name='br-int',has_traffic_filtering=True,id=7c0690b6-99ad-420f-a371-9463c3d9e2c5,network=Network(6be19388-221e-4a81-a5b5-c5b1c235bb3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c0690b6-99')
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:76:f0,bridge_name='br-int',has_traffic_filtering=True,id=37d5162f-6cf7-47a6-8d10-98d4a63b0706,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37d5162f-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:76:f0,bridge_name='br-int',has_traffic_filtering=True,id=37d5162f-6cf7-47a6-8d10-98d4a63b0706,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37d5162f-6c') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37d5162f-6c, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2078396d-0998-464c-a6c2-6cb37e695671) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: INFO os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:76:f0,bridge_name='br-int',has_traffic_filtering=True,id=37d5162f-6cf7-47a6-8d10-98d4a63b0706,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap37d5162f-6c')
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:16:9d,bridge_name='br-int',has_traffic_filtering=True,id=08fd5394-cd17-4456-a310-e65e34282584,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08fd5394-cd') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:16:9d,bridge_name='br-int',has_traffic_filtering=True,id=08fd5394-cd17-4456-a310-e65e34282584,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08fd5394-cd') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08fd5394-cd, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e14ab740-02ee-4f48-af37-07a8632236e5) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: INFO os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:16:9d,bridge_name='br-int',has_traffic_filtering=True,id=08fd5394-cd17-4456-a310-e65e34282584,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08fd5394-cd')
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "address": "fa:16:3e:56:07:4f", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5134743-9a", "ovs_interfaceid": "e5134743-9a4e-4508-8ff2-9fb481463a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=e5134743-9a4e-4508-8ff2-9fb481463a8a,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5134743-9a') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=e5134743-9a4e-4508-8ff2-9fb481463a8a,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5134743-9a') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5134743-9a, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e046f926-328c-4ef7-a6fd-c247f6c684df) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:46 user nova-compute[75006]: WARNING nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-7c0690b6-99ad-420f-a371-9463c3d9e2c5 for instance with vm_state active and task_state deleting.
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-unplugged-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-78edd02e-d9e2-42f0-874b-ccec70162773 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:46 user nova-compute[75006]: WARNING nova.compute.manager [req-573d7f20-f5c7-48b7-9e04-5f7a91b95b94 req-fec6993c-1ff3-4412-8c47-67f9efaa04b5 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-78edd02e-d9e2-42f0-874b-ccec70162773 for instance with vm_state active and task_state deleting.
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: INFO os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=e5134743-9a4e-4508-8ff2-9fb481463a8a,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5134743-9a')
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:13:91,bridge_name='br-int',has_traffic_filtering=True,id=ef72d3cb-a396-4554-b801-ddfc0c017b66,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef72d3cb-a3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:13:91,bridge_name='br-int',has_traffic_filtering=True,id=ef72d3cb-a396-4554-b801-ddfc0c017b66,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef72d3cb-a3') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef72d3cb-a3, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8adcb9c-8b91-4cdb-b5a6-ad8a2538a311) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: INFO os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:13:91,bridge_name='br-int',has_traffic_filtering=True,id=ef72d3cb-a396-4554-b801-ddfc0c017b66,network=Network(10d600f7-4c94-406d-bd0f-a4b16d57b053),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef72d3cb-a3')
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9b:be,bridge_name='br-int',has_traffic_filtering=True,id=78edd02e-d9e2-42f0-874b-ccec70162773,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78edd02e-d9') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9b:be,bridge_name='br-int',has_traffic_filtering=True,id=78edd02e-d9e2-42f0-874b-ccec70162773,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78edd02e-d9') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78edd02e-d9, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3ceae9f-e3f8-4673-b4d2-1ea143d13425) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: INFO os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:9b:be,bridge_name='br-int',has_traffic_filtering=True,id=78edd02e-d9e2-42f0-874b-ccec70162773,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78edd02e-d9')
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:18:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1756560931',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1756560931',id=11,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA2E2tK1HSBcdFk6nV8uuo0eZo0s66lO+gTf2UXTWWnS5Uc8dtbWfs2RwIYOMZvRSgOMgyIoM5TzLNcVIt/jblUqGKmWLL912nqyvXb7eB9Bcz7b0JjlxU8Coo1wQ/rVQ==',key_name='tempest-keypair-125630815',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88b657ee609745b6992fa114bc8f2308',ramdisk_id='',reservation_id='r-4gc86s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-383429421',owner_user_name='tempest-TaggedBootDevicesTest_v242-383429421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eaefb35723c4150b9cf83de7aec498c',uuid=fc95fb16-d2f5-4f45-ac78-bcd060f585a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converting VIF {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=ec378bc7-8992-4738-a489-c805120ae864,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec378bc7-89') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=ec378bc7-8992-4738-a489-c805120ae864,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec378bc7-89') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec378bc7-89, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8f6f5d7-01ef-49b3-9d96-117a9f94c321) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:46 user nova-compute[75006]: INFO os_vif [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:bd:d4,bridge_name='br-int',has_traffic_filtering=True,id=ec378bc7-8992-4738-a489-c805120ae864,network=Network(a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec378bc7-89')
Nov 27 03:20:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgeuCYEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:46 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea8b622-af2a-4a59-a64b-07e687ace202]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:46 user nova-compute[75006]: No targets found.
Nov 27 03:20:46 user nova-compute[75006]: iSNS:
Nov 27 03:20:46 user nova-compute[75006]: No targets found.
Nov 27 03:20:46 user nova-compute[75006]: STATIC:
Nov 27 03:20:46 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:46 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:46 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:46 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed
Nov 27 03:20:46 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:46 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:46 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:46 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:46 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:46 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a
Nov 27 03:20:46 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:46 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:46 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb
Nov 27 03:20:46 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:46 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:46 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:46 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:46 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:46 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:46 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:46 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:46 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:46 user nova-compute[75006]: No targets found.
Nov 27 03:20:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:46 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:46 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[158bf9aa-1eab-4ff7-ba04-364559cd35f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1336d8c1-1928-4fb3-a199-5eabf1086c45]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:46 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed'): ({'sdc'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Removing single pathed devices sdc {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3fd7da-a27b-40eb-95b8-19276ce40b78]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b811a8-d4d8-48a8-9cf4-7b585715dd57]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Flushing IO for device /dev/sdc {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d9642f-d361-4e9c-abaf-742e5ae1eb9d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab048d9-2b0f-4618-8279-59f8f82c18c9]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4d85b-6aff-4559-9d39-4cb0ace58b2d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c726bd29-f0e9-496a-8a6f-3ea2262c7f69]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed, portal: 172.16.0.220,3260]
Nov 27 03:20:46 user nova-compute[75006]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3e59352-8327-49e8-97c2-18693825c2ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bddb2e9-06b5-4807-8e1f-b5a71c395af8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== disconnect_volume: return (391ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnwaRPuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:47 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[781f069f-19de-4263-b15c-25d4c08dd9d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]: iSNS:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]: STATIC:
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:47 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:47 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99265aa-bf03-4aee-8043-b0f0538055c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3a19ea-7418-4e90-9a95-3c7af5ff2cde]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8192463c-0589-4a75-97ec-24a5d9149c7f is timed out.
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bbf682-35ab-4ea9-bf48-e63fd931fb97]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Successfully detached device vdb from instance 8192463c-0589-4a75-97ec-24a5d9149c7f from the live domain config.
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FlmBvDQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:47 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3483725-869a-46cd-8fe3-43cb956f8f19]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d3b34d-a584-46df-9041-e5fad27fe520]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a659f40d-a5a5-4f2b-b235-fdd20aeff103]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6801274-8b08-494d-bead-2e6f72d3974f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33e6c17-acb9-46e1-b6bd-45f8b0f23625]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a, portal: 172.16.0.220,3260]
Nov 27 03:20:47 user nova-compute[75006]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e29086-9d43-40b7-9b2a-495ed269eb5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d431af-e959-413f-abab-8909fe324b97]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== disconnect_volume: return (433ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.267s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jWSBGhst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:47 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2183be4e-bc8e-4991-9927-804dc426d810]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]: iSNS:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]: STATIC:
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:47 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:47 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[20219d0a-5b83-4ba9-b32b-1ca071bfb432]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c992064e-c15c-499c-8470-27e894b299c2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:47 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b16e56-96c1-4bfa-afde-14aafb676a6a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-unplugged-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-unplugged-ec378bc7-8992-4738-a489-c805120ae864 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] Acquiring lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] No waiting events found dispatching network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:47 user nova-compute[75006]: WARNING nova.compute.manager [req-72188eb4-8bce-4f14-a627-7ca35062f612 req-19bfdd5b-393a-4361-b833-7332c23d00d7 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received unexpected event network-vif-plugged-ec378bc7-8992-4738-a489-c805120ae864 for instance with vm_state active and task_state deleting.
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfac39f7-8d10-4c76-9ff4-1d44699d6cc6]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec321f09-ab03-4be2-ae04-945d33a7f883]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b7c8aa-8548-4c5a-b21c-fbd9e894732b]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cb31eb-362b-4eee-8abc-1c0f0c904fa8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[707538a6-a4ad-470d-b86b-ccd1826c2526]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb, portal: 172.16.0.220,3260]
Nov 27 03:20:47 user nova-compute[75006]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6594445-bcf4-4d37-9cc4-0e6aaefeeabb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2245bd-2733-4e74-8208-d375d7330f4a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] <== disconnect_volume: return (648ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.389s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1002959-acb9-4fdf-8163-e43674223655]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]: iSNS:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]: STATIC:
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:47 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:47 user nova-compute[75006]: No targets found.
Nov 27 03:20:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:47 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:47 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7860f52-4cab-42f9-984c-7c5e5bbc0849]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:20:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7055MB free_disk=25.48553466796875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b36c1-c7d7-4d0c-8d31-aa42c8ed631e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:48 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:48 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:48 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:48 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:48 user nova-compute[75006]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 (non-flash)
Nov 27 03:20:48 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:48 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:48 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c1635b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73c1a16-5d4f-4943-8509-94e246798f34]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67ca31-d398-47a5-b279-e808948af191]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[063c3e15-b665-4637-9f47-7c453f6737f0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19abf980-5029-4ea7-93bc-615535869833]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fd992ae2-0b97-47d2-9e03-f707af65f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5ee0634e-e918-4e98-a42c-496e3f7de095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 8192463c-0589-4a75-97ec-24a5d9149c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 503a960f-c3f6-4b8f-af89-7796916be32c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fc95fb16-d2f5-4f45-ac78-bcd060f585a8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5956b54a-82d6-44f4-95f6-e92408ea924d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 3dd80363-c3bb-42ea-8ea5-ab23526fd395 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance f6c29a59-34d3-4aa9-8c87-447f0b3a0f74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.108s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a5084f-3407-40ef-b897-a175ed7df730]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:20:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Creating image(s)
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Ensure instance console log exists: /opt/stack/data/nova/instances/503a960f-c3f6-4b8f-af89-7796916be32c/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Start _get_guest_xml network_info=[{"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '3851bdd2-c550-41b6-b9e4-9b4ed8ad09ba', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '503a960f-c3f6-4b8f-af89-7796916be32c', 'attached_at': '', 'detached_at': '', 'volume_id': '13409c5f-0143-40b9-92f9-42dea666781d', 'serial': '13409c5f-0143-40b9-92f9-42dea666781d'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:20:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 03:20:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.objects.instance [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lazy-loading 'vcpu_model' on Instance uuid 503a960f-c3f6-4b8f-af89-7796916be32c {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8ad97d-2139-491a-9773-d0a526882d81]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0, portal: 172.16.0.220,3260]
Nov 27 03:20:48 user nova-compute[75006]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:48 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:48 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eada81f-afaf-4f21-8e66-e2c5984408e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2add8473-3cfe-456c-90ce-87a123d19b79]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78af3b73-bce3-4e4b-b040-eda0d6af7050', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe428d41-58e9-4036-a448-50de57a0b833', 'serial': 'fe428d41-58e9-4036-a448-50de57a0b833'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdFgsKvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '52f1cff6-8764-4ef9-a924-d989a329bdcf'}, 'status': 'reserved', 'instance': '78af3b73-bce3-4e4b-b040-eda0d6af7050', 'attached_at': '', 'detached_at': '', 'volume_id': '52f1cff6-8764-4ef9-a924-d989a329bdcf', 'serial'} {{(pid=75006) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.981s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] <== disconnect_volume: return (1370ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Deleting instance files /opt/stack/data/nova/instances/fc95fb16-d2f5-4f45-ac78-bcd060f585a8_del
Nov 27 03:20:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Deletion of /opt/stack/data/nova/instances/fc95fb16-d2f5-4f45-ac78-bcd060f585a8_del complete
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.016s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:48 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:48 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:48 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a8d632-f3be-47b4-94eb-62b74bc2ef80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:20:48 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b8fc91-571f-44b7-8a8e-4b92db9033ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d] added
Nov 27 03:20:48 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: INFO nova.compute.manager [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Took 5.37 seconds to destroy the instance on the hypervisor.
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda04f0b-311c-4bc7-98bf-c6df72955af1]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ca917b-84b5-4abe-b4cd-dbd292e1bbc3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TURPKwXD {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TURPKwXD" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603bdc2-9e1d-412e-ba91-92c1a0b751b5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TURPKwXD'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3f0f11-020d-4447-bdb7-e8724ba5c787]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea65bf1-9a95-46f6-9bdc-21459061f25e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0366ef6-988e-4469-8800-a327f91c7310]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260]
Nov 27 03:20:49 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.765s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67099cf-77e1-4c35-a978-cfa1e9a9d549]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e060e03a-ac68-4c18-b6c1-f4d3e5d195aa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:49 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG nova.objects.instance [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lazy-loading 'flavor' on Instance uuid 8192463c-0589-4a75-97ec-24a5d9149c7f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c63c1c-d749-4eed-903b-24b18c965616]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-93621120-2da2-4d8d-aad2-a5bd8f8ed83f tempest-VolumesAssistedSnapshotsTest-598445461 tempest-VolumesAssistedSnapshotsTest-598445461-project-admin] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.686s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23563323566326266', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563323566326266', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.397s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:50 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:50 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215776583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1739552079',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEwjlY0CoUcygTkC5MyCYRqbOE6ERSsD3pzuc1AA/39Q08Ghvl6YSDYF0crP8xc6jrODLO9Q5HWNs2BEYtVvjp1IiwJwNqfALKa03qefDLZ2IO8YLyjexGBUJf2j1WyOg==',key_name='tempest-keypair-1820861676',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f859896de4a04f35a385b771412f684a',ramdisk_id='',reservation_id='r-7qq7bj0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-647617165',owner_user_name='tempest-ServerActionsV293TestJSON-647617165-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:20:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693d59e66f9e41478ce9a1d199f7633d',uuid=503a960f-c3f6-4b8f-af89-7796916be32c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converting VIF {"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:20:50 user nova-compute[75006]:   <uuid>503a960f-c3f6-4b8f-af89-7796916be32c</uuid>
Nov 27 03:20:50 user nova-compute[75006]:   <name>instance-0000000a</name>
Nov 27 03:20:50 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:20:50 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:20:50 user nova-compute[75006]:   <metadata>
Nov 27 03:20:50 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:20:50 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:20:50 user nova-compute[75006]:       <nova:name>tempest-ServerActionsV293TestJSON-server-215776583</nova:name>
Nov 27 03:20:50 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:20:48</nova:creationTime>
Nov 27 03:20:50 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:20:50 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:20:50 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:20:50 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:20:50 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:20:50 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:20:50 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:20:50 user nova-compute[75006]:       <nova:owner>
Nov 27 03:20:50 user nova-compute[75006]:         <nova:user uuid="693d59e66f9e41478ce9a1d199f7633d">tempest-ServerActionsV293TestJSON-647617165-project-member</nova:user>
Nov 27 03:20:50 user nova-compute[75006]:         <nova:project uuid="f859896de4a04f35a385b771412f684a">tempest-ServerActionsV293TestJSON-647617165</nova:project>
Nov 27 03:20:50 user nova-compute[75006]:       </nova:owner>
Nov 27 03:20:50 user nova-compute[75006]:       <nova:ports>
Nov 27 03:20:50 user nova-compute[75006]:         <nova:port uuid="1856fd0c-42fd-44e2-b937-2bf7564d7f13">
Nov 27 03:20:50 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 03:20:50 user nova-compute[75006]:         </nova:port>
Nov 27 03:20:50 user nova-compute[75006]:       </nova:ports>
Nov 27 03:20:50 user nova-compute[75006]:     </nova:instance>
Nov 27 03:20:50 user nova-compute[75006]:   </metadata>
Nov 27 03:20:50 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:20:50 user nova-compute[75006]:     <system>
Nov 27 03:20:50 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:20:50 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:20:50 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:20:50 user nova-compute[75006]:       <entry name="serial">503a960f-c3f6-4b8f-af89-7796916be32c</entry>
Nov 27 03:20:50 user nova-compute[75006]:       <entry name="uuid">503a960f-c3f6-4b8f-af89-7796916be32c</entry>
Nov 27 03:20:50 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:20:50 user nova-compute[75006]:     </system>
Nov 27 03:20:50 user nova-compute[75006]:   </sysinfo>
Nov 27 03:20:50 user nova-compute[75006]:   <os>
Nov 27 03:20:50 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:20:50 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:20:50 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:20:50 user nova-compute[75006]:   </os>
Nov 27 03:20:50 user nova-compute[75006]:   <features>
Nov 27 03:20:50 user nova-compute[75006]:     <acpi/>
Nov 27 03:20:50 user nova-compute[75006]:     <apic/>
Nov 27 03:20:50 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:20:50 user nova-compute[75006]:   </features>
Nov 27 03:20:50 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:20:50 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:20:50 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:20:50 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:20:50 user nova-compute[75006]:   </clock>
Nov 27 03:20:50 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:20:50 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:20:50 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:20:50 user nova-compute[75006]:   </cpu>
Nov 27 03:20:50 user nova-compute[75006]:   <devices>
Nov 27 03:20:50 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:20:50 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:50 user nova-compute[75006]:       <source dev="/dev/sdb"/>
Nov 27 03:20:50 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:20:50 user nova-compute[75006]:       <serial>13409c5f-0143-40b9-92f9-42dea666781d</serial>
Nov 27 03:20:50 user nova-compute[75006]:     </disk>
Nov 27 03:20:50 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:20:50 user nova-compute[75006]:       <mac address="fa:16:3e:2a:05:68"/>
Nov 27 03:20:50 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:20:50 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:20:50 user nova-compute[75006]:       <target dev="tap1856fd0c-42"/>
Nov 27 03:20:50 user nova-compute[75006]:     </interface>
Nov 27 03:20:50 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:20:50 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/503a960f-c3f6-4b8f-af89-7796916be32c/console.log" append="off"/>
Nov 27 03:20:50 user nova-compute[75006]:     </serial>
Nov 27 03:20:50 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:20:50 user nova-compute[75006]:     <video>
Nov 27 03:20:50 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:20:50 user nova-compute[75006]:     </video>
Nov 27 03:20:50 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:20:50 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:20:50 user nova-compute[75006]:     </rng>
Nov 27 03:20:50 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:20:50 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:20:50 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:20:50 user nova-compute[75006]:     </memballoon>
Nov 27 03:20:50 user nova-compute[75006]:   </devices>
Nov 27 03:20:50 user nova-compute[75006]: </domain>
Nov 27 03:20:50 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215776583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1739552079',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEwjlY0CoUcygTkC5MyCYRqbOE6ERSsD3pzuc1AA/39Q08Ghvl6YSDYF0crP8xc6jrODLO9Q5HWNs2BEYtVvjp1IiwJwNqfALKa03qefDLZ2IO8YLyjexGBUJf2j1WyOg==',key_name='tempest-keypair-1820861676',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f859896de4a04f35a385b771412f684a',ramdisk_id='',reservation_id='r-7qq7bj0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-647617165',owner_user_name='tempest-ServerActionsV293TestJSON-647617165-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:20:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693d59e66f9e41478ce9a1d199f7633d',uuid=503a960f-c3f6-4b8f-af89-7796916be32c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converting VIF {"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_vif [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec70f7f-e5cb-4982-83d7-91df2ee9ad19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:20:50 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '288f85c3-93e1-5b4b-a7d3-657965cc2f87', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1856fd0c-42, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1856fd0c-42, col_values=(('qos', UUID('c846d2af-e7f3-45c8-8337-55d8abbe8c66')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1856fd0c-42, col_values=(('external_ids', {'iface-id': '1856fd0c-42fd-44e2-b937-2bf7564d7f13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:05:68', 'vm-uuid': '503a960f-c3f6-4b8f-af89-7796916be32c'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce1d392-de37-4886-868a-52e43fe242d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833] added
Nov 27 03:20:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:50 user nova-compute[75006]: INFO os_vif [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42')
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e912d719-9507-49e9-b7d0-9b9c5a068237]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f8f24f-131b-451e-aae3-74b46e2df9eb]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbzHwmhW {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbzHwmhW" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c85954-a687-4f93-bfad-43e5df76479f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jbzHwmhW'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] No VIF found with MAC fa:16:3e:2a:05:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa97c952-63f9-4fa5-b2f9-cb5ea3956101]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa53ab0-8299-48cb-96c6-f8704b0bba10]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0e9984-80e1-431a-94a3-06fe0a129608]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260]
Nov 27 03:20:50 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d92dfd-77f5-4233-a401-7be6631af2e8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0918b3ef-e88d-4af8-9da6-64b8ddabd1b8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:50 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f8771-95ae-4ed7-bff2-a4092d35c41d]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-6c1cc9aa-691b-4106-97f9-60dee93da8b3 req-4f850af7-8a17-4318-8559-f44dbf7907e1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-deleted-e5134743-9a4e-4508-8ff2-9fb481463a8a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:50 user nova-compute[75006]: INFO nova.compute.manager [req-6c1cc9aa-691b-4106-97f9-60dee93da8b3 req-4f850af7-8a17-4318-8559-f44dbf7907e1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Neutron deleted interface e5134743-9a4e-4508-8ff2-9fb481463a8a; detaching it from the instance and deleting it from the info cache
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-6c1cc9aa-691b-4106-97f9-60dee93da8b3 req-4f850af7-8a17-4318-8559-f44dbf7907e1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [{"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "78edd02e-d9e2-42f0-874b-ccec70162773", "address": "fa:16:3e:f3:9b:be", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78edd02e-d9", "ovs_interfaceid": "78edd02e-d9e2-42f0-874b-ccec70162773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-6c1cc9aa-691b-4106-97f9-60dee93da8b3 req-4f850af7-8a17-4318-8559-f44dbf7907e1 service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Detach interface failed, port_id=e5134743-9a4e-4508-8ff2-9fb481463a8a, reason: Instance fc95fb16-d2f5-4f45-ac78-bcd060f585a8 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] <== connect_volume: return (2786ms) {'type': 'block', 'scsi_wwn': '26135643336316330', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135643336316330', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG nova.objects.instance [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lazy-loading 'flavor' on Instance uuid 78af3b73-bce3-4e4b-b040-eda0d6af7050 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:20:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 159383552 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-deleted-78edd02e-d9e2-42f0-874b-ccec70162773 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:53 user nova-compute[75006]: INFO nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Neutron deleted interface 78edd02e-d9e2-42f0-874b-ccec70162773; detaching it from the instance and deleting it from the info cache
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.network.neutron [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [{"id": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "address": "fa:16:3e:b6:d7:af", "network": {"id": "6be19388-221e-4a81-a5b5-c5b1c235bb3b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-751524906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c0690b6-99", "ovs_interfaceid": "7c0690b6-99ad-420f-a371-9463c3d9e2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Detach interface failed, port_id=78edd02e-d9e2-42f0-874b-ccec70162773, reason: Instance fc95fb16-d2f5-4f45-ac78-bcd060f585a8 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] No waiting events found dispatching network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:53 user nova-compute[75006]: WARNING nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received unexpected event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 for instance with vm_state active and task_state rebuild_spawning.
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-deleted-7c0690b6-99ad-420f-a371-9463c3d9e2c5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:53 user nova-compute[75006]: INFO nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Neutron deleted interface 7c0690b6-99ad-420f-a371-9463c3d9e2c5; detaching it from the instance and deleting it from the info cache
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.network.neutron [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [{"id": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "address": "fa:16:3e:ec:76:f0", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d5162f-6c", "ovs_interfaceid": "37d5162f-6cf7-47a6-8d10-98d4a63b0706", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08fd5394-cd17-4456-a310-e65e34282584", "address": "fa:16:3e:79:16:9d", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08fd5394-cd", "ovs_interfaceid": "08fd5394-cd17-4456-a310-e65e34282584", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "address": "fa:16:3e:d7:13:91", "network": {"id": "10d600f7-4c94-406d-bd0f-a4b16d57b053", "bridge": "br-int", "label": "tempest-device-tagging-net1-106698210", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef72d3cb-a3", "ovs_interfaceid": "ef72d3cb-a396-4554-b801-ddfc0c017b66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ec378bc7-8992-4738-a489-c805120ae864", "address": "fa:16:3e:9c:bd:d4", "network": {"id": "a3c90bdc-b2c2-43f6-8b5d-bededff7f3c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-1855785248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "88b657ee609745b6992fa114bc8f2308", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec378bc7-89", "ovs_interfaceid": "ec378bc7-8992-4738-a489-c805120ae864", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Detach interface failed, port_id=7c0690b6-99ad-420f-a371-9463c3d9e2c5, reason: Instance fc95fb16-d2f5-4f45-ac78-bcd060f585a8 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] No waiting events found dispatching network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:53 user nova-compute[75006]: WARNING nova.compute.manager [req-b1e4db22-ccec-4527-8ce0-4b01e4e0aa4a req-81ef633b-bc8d-4057-9da8-d15261a2f39b service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received unexpected event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 for instance with vm_state active and task_state rebuild_spawning.
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 334495744 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 510656512 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:54 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Took 5.51 seconds to deallocate network for instance.
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 654311424 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "5956b54a-82d6-44f4-95f6-e92408ea924d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:54 user nova-compute[75006]: INFO nova.compute.manager [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Terminating instance
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:20:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance spawned successfully.
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-506f455a-8f86-434c-8fa3-01e8cb559047 req-8c8fb7f2-116b-4110-90b8-d81e448881bb service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received event network-vif-unplugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-506f455a-8f86-434c-8fa3-01e8cb559047 req-8c8fb7f2-116b-4110-90b8-d81e448881bb service nova] Acquiring lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-506f455a-8f86-434c-8fa3-01e8cb559047 req-8c8fb7f2-116b-4110-90b8-d81e448881bb service nova] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-506f455a-8f86-434c-8fa3-01e8cb559047 req-8c8fb7f2-116b-4110-90b8-d81e448881bb service nova] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-506f455a-8f86-434c-8fa3-01e8cb559047 req-8c8fb7f2-116b-4110-90b8-d81e448881bb service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] No waiting events found dispatching network-vif-unplugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-506f455a-8f86-434c-8fa3-01e8cb559047 req-8c8fb7f2-116b-4110-90b8-d81e448881bb service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received event network-vif-unplugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 771751936 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-33fc15d6-7044-48b7-b238-ab349f70baa8 req-f68c6570-0ff8-4f96-b2ff-b3562c64e20f service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-deleted-ef72d3cb-a396-4554-b801-ddfc0c017b66 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-33fc15d6-7044-48b7-b238-ab349f70baa8 req-f68c6570-0ff8-4f96-b2ff-b3562c64e20f service nova] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Received event network-vif-deleted-ec378bc7-8992-4738-a489-c805120ae864 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75006) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60cdabc2-9461-40a3-a670-02930d730dbc tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Instance destroyed successfully.
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lazy-loading 'resources' on Instance uuid 5956b54a-82d6-44f4-95f6-e92408ea924d {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-754625581',display_name='tempest-VolumesActionsTest-instance-754625581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-754625581',id=12,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f1e458a5b9b461bbdba0924d0cc6750',ramdisk_id='',reservation_id='r-rfxnl23r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1256624352',owner_user_name='tempest-VolumesActionsTest-1256624352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:03Z,user_data=None,user_id='06346aa70a26471084876444d2f6b053',uuid=5956b54a-82d6-44f4-95f6-e92408ea924d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Converting VIF {"id": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "address": "fa:16:3e:ef:86:d4", "network": {"id": "33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-85834557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1e458a5b9b461bbdba0924d0cc6750", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ddbccec-7e", "ovs_interfaceid": "5ddbccec-7ebb-442f-a27c-3ed76e9a24e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:d4,bridge_name='br-int',has_traffic_filtering=True,id=5ddbccec-7ebb-442f-a27c-3ed76e9a24e9,network=Network(33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddbccec-7e') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG os_vif [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:d4,bridge_name='br-int',has_traffic_filtering=True,id=5ddbccec-7ebb-442f-a27c-3ed76e9a24e9,network=Network(33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddbccec-7e') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ddbccec-7e, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6610f61-9dc6-4b74-99cf-4027a1ea9998) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:55 user nova-compute[75006]: INFO os_vif [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:86:d4,bridge_name='br-int',has_traffic_filtering=True,id=5ddbccec-7ebb-442f-a27c-3ed76e9a24e9,network=Network(33028c0e-19ac-4d3e-88ad-58ddfe1b6bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ddbccec-7e')
Nov 27 03:20:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Deleting instance files /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d_del
Nov 27 03:20:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Deletion of /opt/stack/data/nova/instances/5956b54a-82d6-44f4-95f6-e92408ea924d_del complete
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 844103680 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:55 user nova-compute[75006]: INFO nova.compute.manager [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 27 03:20:55 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:20:55 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 969932800 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:20:56 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Took 0.85 seconds to deallocate network for instance.
Nov 27 03:20:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 1062207488 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:56 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Deleted allocations for instance 5956b54a-82d6-44f4-95f6-e92408ea924d
Nov 27 03:20:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-103a80e9-48a4-499c-883b-edddd139e068 req-3abef57f-86b2-46a7-9f0f-a5d7e5a24e2f service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received event network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-103a80e9-48a4-499c-883b-edddd139e068 req-3abef57f-86b2-46a7-9f0f-a5d7e5a24e2f service nova] Acquiring lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-103a80e9-48a4-499c-883b-edddd139e068 req-3abef57f-86b2-46a7-9f0f-a5d7e5a24e2f service nova] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-103a80e9-48a4-499c-883b-edddd139e068 req-3abef57f-86b2-46a7-9f0f-a5d7e5a24e2f service nova] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-103a80e9-48a4-499c-883b-edddd139e068 req-3abef57f-86b2-46a7-9f0f-a5d7e5a24e2f service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] No waiting events found dispatching network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:20:56 user nova-compute[75006]: WARNING nova.compute.manager [req-103a80e9-48a4-499c-883b-edddd139e068 req-3abef57f-86b2-46a7-9f0f-a5d7e5a24e2f service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received unexpected event network-vif-plugged-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 for instance with vm_state deleted and task_state None.
Nov 27 03:20:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fe556d2e-4ec5-4f4c-be33-1b91640cfe08 tempest-VolumesActionsTest-1256624352 tempest-VolumesActionsTest-1256624352-project-member] Lock "5956b54a-82d6-44f4-95f6-e92408ea924d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.555s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdFgsKvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': '52f1cff6-8764-4ef9-a924-d989a329bdcf'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:20:57 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-24f58d71-42b7-427b-8539-f2bc088d10d3 req-24d57b68-268e-40bc-a1bd-3a19fc29b87c service nova] [instance: 5956b54a-82d6-44f4-95f6-e92408ea924d] Received event network-vif-deleted-5ddbccec-7ebb-442f-a27c-3ed76e9a24e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed85a95-1c12-4c57-a86e-420243661805]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:20:57 user nova-compute[75006]: No targets found.
Nov 27 03:20:57 user nova-compute[75006]: iSNS:
Nov 27 03:20:57 user nova-compute[75006]: No targets found.
Nov 27 03:20:57 user nova-compute[75006]: STATIC:
Nov 27 03:20:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d
Nov 27 03:20:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:20:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833
Nov 27 03:20:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf
Nov 27 03:20:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:20:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:20:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:20:57 user nova-compute[75006]: FIRMWARE:
Nov 27 03:20:57 user nova-compute[75006]: No targets found.
Nov 27 03:20:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:20:57 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:20:57 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4991202c-5c72-475b-809b-2894ed801c5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ca4b48-cde3-4b6c-897e-f74068b0fa78]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:57 user nova-compute[75006]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:57 user nova-compute[75006]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:57 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:57 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf (non-flash)
Nov 27 03:20:57 user nova-compute[75006]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:20:57 user nova-compute[75006]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:20:57 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:20:57 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:20:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4482e3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf'): ({'sdl'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Removing single pathed devices sdl {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1e62bc-6036-406f-b8fc-953774a7fcc6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d85eb7-1bb9-4ed0-a3b6-1987575ae748]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Flushing IO for device /dev/sdl {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de2fb3-d444-4f8f-bddb-5d8dc20115db]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.045s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[34866516-bacd-4265-9522-b870388d4010]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] SCSI volumes sdl have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0689fd1f-d360-4484-934f-23beb2cd7090]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384a1a3-b087-42c0-89bf-e97f9db82884]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf, portal: 172.16.0.220,3260]
Nov 27 03:20:57 user nova-compute[75006]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf, portal: 172.16.0.220,3260] successful.
Nov 27 03:20:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52f1cff6-8764-4ef9-a924-d989a329bdcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[896c1bc4-1526-48d3-897e-8354e084bc10]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] <== disconnect_volume: return (366ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '78af3b73-bce3-4e4b-b040-eda0d6af7050', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe428d41-58e9-4036-a448-50de57a0b833', 'serial'} {{(pid=75006) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] swap_volume: removing Cinder connection for volume 52f1cff6-8764-4ef9-a924-d989a329bdcf {{(pid=75006) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 27 03:20:57 user nova-compute[75006]: INFO nova.compute.manager [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] [instance: fc95fb16-d2f5-4f45-ac78-bcd060f585a8] Took 3.26 seconds to detach 3 volumes for instance.
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:58 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:20:58 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:20:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:58 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Deleted allocations for instance fc95fb16-d2f5-4f45-ac78-bcd060f585a8
Nov 27 03:20:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2a4d975d-91a4-4108-9e4e-a29cfb798c61 tempest-TaggedBootDevicesTest_v242-383429421 tempest-TaggedBootDevicesTest_v242-383429421-project-member] Lock "fc95fb16-d2f5-4f45-ac78-bcd060f585a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.896s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] swap_volume: Updating volume 52f1cff6-8764-4ef9-a924-d989a329bdcf BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "jbzHwmhW", "auth_password": "ISAFVJyOrnuQtj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "fe428d41-58e9-4036-a448-50de57a0b833"}, "status": "reserved", "instance": "78af3b73-bce3-4e4b-b040-eda0d6af7050", "attached_at": "", "detached_at": "", "volume_id": "fe428d41-58e9-4036-a448-50de57a0b833", "serial": "fe428d41-58e9-4036-a448-50de57a0b833"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'fe428d41-58e9-4036-a448-50de57a0b833', 'no_device': None, 'attachment_id': '5076f181-761f-40bf-9e5c-464c1c04360e'} {{(pid=75006) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 27 03:20:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9416f2db-ecaf-4aed-ab38-de3289cf0f26 tempest-TestVolumeSwap-1277502660 tempest-TestVolumeSwap-1277502660-project-admin] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.209s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:20:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:20:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:20:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:20:59 user nova-compute[75006]: INFO nova.compute.manager [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Detaching volume fe428d41-58e9-4036-a448-50de57a0b833
Nov 27 03:20:59 user nova-compute[75006]: INFO nova.virt.block_device [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Attempting to driver detach volume fe428d41-58e9-4036-a448-50de57a0b833 from mountpoint /dev/vdb
Nov 27 03:20:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Attempting to detach device vdb from instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:20:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:20:59 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:59 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:20:59 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:59 user nova-compute[75006]:   <serial>fe428d41-58e9-4036-a448-50de57a0b833</serial>
Nov 27 03:20:59 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:20:59 user nova-compute[75006]: </disk>
Nov 27 03:20:59 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:20:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Successfully detached device vdb from instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 from the persistent domain config.
Nov 27 03:20:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:20:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:20:59 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:20:59 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:20:59 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:20:59 user nova-compute[75006]:   <serial>fe428d41-58e9-4036-a448-50de57a0b833</serial>
Nov 27 03:20:59 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:20:59 user nova-compute[75006]: </disk>
Nov 27 03:20:59 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:21:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:21:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:21:06 user nova-compute[75006]: INFO nova.compute.claims [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Claim successful on node user
Nov 27 03:21:06 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:21:07 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.policy [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fe95d495e394f6094f76fa8a9bdf8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec104eb22944c46a2ed69b13fc26eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:21:07 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Creating image(s)
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "e1b3e5d0-c175-42e0-bf86-79839548aadf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Successfully created port: 1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.195s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:21:07 user nova-compute[75006]: INFO nova.compute.claims [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Claim successful on node user
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk 1073741824" returned: 0 in 0.046s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:21:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Cannot resize image /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Ensure instance console log exists: /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Successfully updated port: 1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquired lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.compute.manager [req-753d93f4-7956-4fd2-bf9c-bc6644b589b0 req-e3069dab-4248-45c6-9455-03f011901795 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-changed-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.compute.manager [req-753d93f4-7956-4fd2-bf9c-bc6644b589b0 req-e3069dab-4248-45c6-9455-03f011901795 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Refreshing instance network info cache due to event network-changed-1ede6185-835b-45f8-a691-5d49116fdd90. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-753d93f4-7956-4fd2-bf9c-bc6644b589b0 req-e3069dab-4248-45c6-9455-03f011901795 service nova] Acquiring lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.796s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:21:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.policy [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f150fc08fad489aa036b747757792f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a358e4342c8a48ddb127bdaf5a9256a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:21:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Creating image(s)
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "/opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "/opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating instance_info_cache with network_info: [{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Releasing lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Instance network_info: |[{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-753d93f4-7956-4fd2-bf9c-bc6644b589b0 req-e3069dab-4248-45c6-9455-03f011901795 service nova] Acquired lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.neutron [req-753d93f4-7956-4fd2-bf9c-bc6644b589b0 req-e3069dab-4248-45c6-9455-03f011901795 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Refreshing network info cache for port 1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Start _get_guest_xml network_info=[{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:21:08 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:08 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converting VIF {"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=1ede6185-835b-45f8-a691-5d49116fdd90,network=Network(7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ede6185-83') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.objects.instance [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:21:08 user nova-compute[75006]:   <uuid>7b4d808c-beca-4008-8733-31afc9b26d80</uuid>
Nov 27 03:21:08 user nova-compute[75006]:   <name>instance-0000000f</name>
Nov 27 03:21:08 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:21:08 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:21:08 user nova-compute[75006]:   <metadata>
Nov 27 03:21:08 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:21:08 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:21:08 user nova-compute[75006]:       <nova:name>tempest-device-tagging-server-1358855801</nova:name>
Nov 27 03:21:08 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:21:08</nova:creationTime>
Nov 27 03:21:08 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:21:08 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:21:08 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:21:08 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:21:08 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:21:08 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:21:08 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:21:08 user nova-compute[75006]:       <nova:owner>
Nov 27 03:21:08 user nova-compute[75006]:         <nova:user uuid="8fe95d495e394f6094f76fa8a9bdf8a0">tempest-TaggedAttachmentsTest-2115441077-project-member</nova:user>
Nov 27 03:21:08 user nova-compute[75006]:         <nova:project uuid="cec104eb22944c46a2ed69b13fc26eec">tempest-TaggedAttachmentsTest-2115441077</nova:project>
Nov 27 03:21:08 user nova-compute[75006]:       </nova:owner>
Nov 27 03:21:08 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:21:08 user nova-compute[75006]:       <nova:ports>
Nov 27 03:21:08 user nova-compute[75006]:         <nova:port uuid="1ede6185-835b-45f8-a691-5d49116fdd90">
Nov 27 03:21:08 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:21:08 user nova-compute[75006]:         </nova:port>
Nov 27 03:21:08 user nova-compute[75006]:       </nova:ports>
Nov 27 03:21:08 user nova-compute[75006]:     </nova:instance>
Nov 27 03:21:08 user nova-compute[75006]:   </metadata>
Nov 27 03:21:08 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:21:08 user nova-compute[75006]:     <system>
Nov 27 03:21:08 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:21:08 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:21:08 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:21:08 user nova-compute[75006]:       <entry name="serial">7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:21:08 user nova-compute[75006]:       <entry name="uuid">7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:21:08 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:21:08 user nova-compute[75006]:     </system>
Nov 27 03:21:08 user nova-compute[75006]:   </sysinfo>
Nov 27 03:21:08 user nova-compute[75006]:   <os>
Nov 27 03:21:08 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:21:08 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:21:08 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:21:08 user nova-compute[75006]:   </os>
Nov 27 03:21:08 user nova-compute[75006]:   <features>
Nov 27 03:21:08 user nova-compute[75006]:     <acpi/>
Nov 27 03:21:08 user nova-compute[75006]:     <apic/>
Nov 27 03:21:08 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:21:08 user nova-compute[75006]:   </features>
Nov 27 03:21:08 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:21:08 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:21:08 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:21:08 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:21:08 user nova-compute[75006]:   </clock>
Nov 27 03:21:08 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:21:08 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:21:08 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:21:08 user nova-compute[75006]:   </cpu>
Nov 27 03:21:08 user nova-compute[75006]:   <devices>
Nov 27 03:21:08 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:21:08 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:21:08 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk"/>
Nov 27 03:21:08 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:21:08 user nova-compute[75006]:     </disk>
Nov 27 03:21:08 user nova-compute[75006]:     <disk type="file" device="cdrom">
Nov 27 03:21:08 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 03:21:08 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.config"/>
Nov 27 03:21:08 user nova-compute[75006]:       <target dev="hda" bus="ide"/>
Nov 27 03:21:08 user nova-compute[75006]:     </disk>
Nov 27 03:21:08 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:21:08 user nova-compute[75006]:       <mac address="fa:16:3e:72:63:dd"/>
Nov 27 03:21:08 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:21:08 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:21:08 user nova-compute[75006]:       <target dev="tap1ede6185-83"/>
Nov 27 03:21:08 user nova-compute[75006]:     </interface>
Nov 27 03:21:08 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:21:08 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log" append="off"/>
Nov 27 03:21:08 user nova-compute[75006]:     </serial>
Nov 27 03:21:08 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:21:08 user nova-compute[75006]:     <video>
Nov 27 03:21:08 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:21:08 user nova-compute[75006]:     </video>
Nov 27 03:21:08 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:21:08 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:21:08 user nova-compute[75006]:     </rng>
Nov 27 03:21:08 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:21:08 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:21:08 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:21:08 user nova-compute[75006]:     </memballoon>
Nov 27 03:21:08 user nova-compute[75006]:   </devices>
Nov 27 03:21:08 user nova-compute[75006]: </domain>
Nov 27 03:21:08 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converting VIF {"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=1ede6185-835b-45f8-a691-5d49116fdd90,network=Network(7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ede6185-83') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG os_vif [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=1ede6185-835b-45f8-a691-5d49116fdd90,network=Network(7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ede6185-83') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1a76e8c-7099-565b-b3fa-be4fea941e8a', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ede6185-83, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ede6185-83, col_values=(('qos', UUID('6bb56a2c-cdf5-4f44-bff3-827993c1d2cd')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ede6185-83, col_values=(('external_ids', {'iface-id': '1ede6185-835b-45f8-a691-5d49116fdd90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:63:dd', 'vm-uuid': '7b4d808c-beca-4008-8733-31afc9b26d80'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:09 user nova-compute[75006]: INFO os_vif [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=1ede6185-835b-45f8-a691-5d49116fdd90,network=Network(7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ede6185-83')
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Successfully created port: 8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No BDM found with device name hda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No VIF found with MAC fa:16:3e:72:63:dd, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:21:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Using config drive
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.223s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk 1073741824" returned: 0 in 0.065s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Creating config drive at /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.config
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdpdo82ix {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdpdo82ix" returned: 0 in 0.058s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-753d93f4-7956-4fd2-bf9c-bc6644b589b0 req-e3069dab-4248-45c6-9455-03f011901795 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updated VIF entry in instance network info cache for port 1ede6185-835b-45f8-a691-5d49116fdd90. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-753d93f4-7956-4fd2-bf9c-bc6644b589b0 req-e3069dab-4248-45c6-9455-03f011901795 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating instance_info_cache with network_info: [{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-753d93f4-7956-4fd2-bf9c-bc6644b589b0 req-e3069dab-4248-45c6-9455-03f011901795 service nova] Releasing lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json" returned: 0 in 0.361s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Cannot resize image /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Ensure instance console log exists: /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Successfully updated port: 8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "refresh_cache-e1b3e5d0-c175-42e0-bf86-79839548aadf" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquired lock "refresh_cache-e1b3e5d0-c175-42e0-bf86-79839548aadf" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-fd81cfab-ff9a-438e-9731-4e8760b695a8 req-1038b7ad-d5bf-4b81-8666-aee063a424c7 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received event network-changed-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-fd81cfab-ff9a-438e-9731-4e8760b695a8 req-1038b7ad-d5bf-4b81-8666-aee063a424c7 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Refreshing instance network info cache due to event network-changed-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd81cfab-ff9a-438e-9731-4e8760b695a8 req-1038b7ad-d5bf-4b81-8666-aee063a424c7 service nova] Acquiring lock "refresh_cache-e1b3e5d0-c175-42e0-bf86-79839548aadf" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:21:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Updating instance_info_cache with network_info: [{"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Releasing lock "refresh_cache-e1b3e5d0-c175-42e0-bf86-79839548aadf" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Instance network_info: |[{"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd81cfab-ff9a-438e-9731-4e8760b695a8 req-1038b7ad-d5bf-4b81-8666-aee063a424c7 service nova] Acquired lock "refresh_cache-e1b3e5d0-c175-42e0-bf86-79839548aadf" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-fd81cfab-ff9a-438e-9731-4e8760b695a8 req-1038b7ad-d5bf-4b81-8666-aee063a424c7 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Refreshing network info cache for port 8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Start _get_guest_xml network_info=[{"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:21:10 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:10 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-943311580',display_name='tempest-VolumesAdminNegativeTest-server-943311580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-943311580',id=16,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a358e4342c8a48ddb127bdaf5a9256a8',ramdisk_id='',reservation_id='r-aty59r1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1662628799',owner_user_name='tempest-VolumesAdminNegativeTest-1662628799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:21:09Z,user_data=None,user_id='4f150fc08fad489aa036b747757792f1',uuid=e1b3e5d0-c175-42e0-bf86-79839548aadf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converting VIF {"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:22,bridge_name='br-int',has_traffic_filtering=True,id=8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2cb34-2c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lazy-loading 'pci_devices' on Instance uuid e1b3e5d0-c175-42e0-bf86-79839548aadf {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:21:10 user nova-compute[75006]:   <uuid>e1b3e5d0-c175-42e0-bf86-79839548aadf</uuid>
Nov 27 03:21:10 user nova-compute[75006]:   <name>instance-00000010</name>
Nov 27 03:21:10 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:21:10 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:21:10 user nova-compute[75006]:   <metadata>
Nov 27 03:21:10 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:21:10 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:21:10 user nova-compute[75006]:       <nova:name>tempest-VolumesAdminNegativeTest-server-943311580</nova:name>
Nov 27 03:21:10 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:21:10</nova:creationTime>
Nov 27 03:21:10 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:21:10 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:21:10 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:21:10 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:21:10 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:21:10 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:21:10 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:21:10 user nova-compute[75006]:       <nova:owner>
Nov 27 03:21:10 user nova-compute[75006]:         <nova:user uuid="4f150fc08fad489aa036b747757792f1">tempest-VolumesAdminNegativeTest-1662628799-project-member</nova:user>
Nov 27 03:21:10 user nova-compute[75006]:         <nova:project uuid="a358e4342c8a48ddb127bdaf5a9256a8">tempest-VolumesAdminNegativeTest-1662628799</nova:project>
Nov 27 03:21:10 user nova-compute[75006]:       </nova:owner>
Nov 27 03:21:10 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:21:10 user nova-compute[75006]:       <nova:ports>
Nov 27 03:21:10 user nova-compute[75006]:         <nova:port uuid="8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6">
Nov 27 03:21:10 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 03:21:10 user nova-compute[75006]:         </nova:port>
Nov 27 03:21:10 user nova-compute[75006]:       </nova:ports>
Nov 27 03:21:10 user nova-compute[75006]:     </nova:instance>
Nov 27 03:21:10 user nova-compute[75006]:   </metadata>
Nov 27 03:21:10 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:21:10 user nova-compute[75006]:     <system>
Nov 27 03:21:10 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:21:10 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:21:10 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:21:10 user nova-compute[75006]:       <entry name="serial">e1b3e5d0-c175-42e0-bf86-79839548aadf</entry>
Nov 27 03:21:10 user nova-compute[75006]:       <entry name="uuid">e1b3e5d0-c175-42e0-bf86-79839548aadf</entry>
Nov 27 03:21:10 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:21:10 user nova-compute[75006]:     </system>
Nov 27 03:21:10 user nova-compute[75006]:   </sysinfo>
Nov 27 03:21:10 user nova-compute[75006]:   <os>
Nov 27 03:21:10 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:21:10 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:21:10 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:21:10 user nova-compute[75006]:   </os>
Nov 27 03:21:10 user nova-compute[75006]:   <features>
Nov 27 03:21:10 user nova-compute[75006]:     <acpi/>
Nov 27 03:21:10 user nova-compute[75006]:     <apic/>
Nov 27 03:21:10 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:21:10 user nova-compute[75006]:   </features>
Nov 27 03:21:10 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:21:10 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:21:10 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:21:10 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:21:10 user nova-compute[75006]:   </clock>
Nov 27 03:21:10 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:21:10 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:21:10 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:21:10 user nova-compute[75006]:   </cpu>
Nov 27 03:21:10 user nova-compute[75006]:   <devices>
Nov 27 03:21:10 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:21:10 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:21:10 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk"/>
Nov 27 03:21:10 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:21:10 user nova-compute[75006]:     </disk>
Nov 27 03:21:10 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:21:10 user nova-compute[75006]:       <mac address="fa:16:3e:d6:3f:22"/>
Nov 27 03:21:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:21:10 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:21:10 user nova-compute[75006]:       <target dev="tap8ea2cb34-2c"/>
Nov 27 03:21:10 user nova-compute[75006]:     </interface>
Nov 27 03:21:10 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:21:10 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/console.log" append="off"/>
Nov 27 03:21:10 user nova-compute[75006]:     </serial>
Nov 27 03:21:10 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:21:10 user nova-compute[75006]:     <video>
Nov 27 03:21:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:21:10 user nova-compute[75006]:     </video>
Nov 27 03:21:10 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:21:10 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:21:10 user nova-compute[75006]:     </rng>
Nov 27 03:21:10 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:21:10 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:21:10 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:21:10 user nova-compute[75006]:     </memballoon>
Nov 27 03:21:10 user nova-compute[75006]:   </devices>
Nov 27 03:21:10 user nova-compute[75006]: </domain>
Nov 27 03:21:10 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-943311580',display_name='tempest-VolumesAdminNegativeTest-server-943311580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-943311580',id=16,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a358e4342c8a48ddb127bdaf5a9256a8',ramdisk_id='',reservation_id='r-aty59r1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1662628799',owner_user_name='tempest-VolumesAdminNegativeTest-1662628799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:21:09Z,user_data=None,user_id='4f150fc08fad489aa036b747757792f1',uuid=e1b3e5d0-c175-42e0-bf86-79839548aadf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converting VIF {"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:22,bridge_name='br-int',has_traffic_filtering=True,id=8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2cb34-2c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG os_vif [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:22,bridge_name='br-int',has_traffic_filtering=True,id=8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2cb34-2c') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14db649b-73ba-53df-8b24-b72eb8afa09b', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea2cb34-2c, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ea2cb34-2c, col_values=(('qos', UUID('54a9bb62-59b9-4eea-9679-793c0c30ac05')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ea2cb34-2c, col_values=(('external_ids', {'iface-id': '8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:3f:22', 'vm-uuid': 'e1b3e5d0-c175-42e0-bf86-79839548aadf'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: INFO os_vif [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:22,bridge_name='br-int',has_traffic_filtering=True,id=8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2cb34-2c')
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] No VIF found with MAC fa:16:3e:d6:3f:22, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-fd81cfab-ff9a-438e-9731-4e8760b695a8 req-1038b7ad-d5bf-4b81-8666-aee063a424c7 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Updated VIF entry in instance network info cache for port 8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-fd81cfab-ff9a-438e-9731-4e8760b695a8 req-1038b7ad-d5bf-4b81-8666-aee063a424c7 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Updating instance_info_cache with network_info: [{"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd81cfab-ff9a-438e-9731-4e8760b695a8 req-1038b7ad-d5bf-4b81-8666-aee063a424c7 service nova] Releasing lock "refresh_cache-e1b3e5d0-c175-42e0-bf86-79839548aadf" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-f7ea608f-4d33-4f57-ac7f-1da892aca227 req-c4c6e3f8-1094-4a52-adf2-b2f5bc52836d service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f7ea608f-4d33-4f57-ac7f-1da892aca227 req-c4c6e3f8-1094-4a52-adf2-b2f5bc52836d service nova] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f7ea608f-4d33-4f57-ac7f-1da892aca227 req-c4c6e3f8-1094-4a52-adf2-b2f5bc52836d service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f7ea608f-4d33-4f57-ac7f-1da892aca227 req-c4c6e3f8-1094-4a52-adf2-b2f5bc52836d service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-f7ea608f-4d33-4f57-ac7f-1da892aca227 req-c4c6e3f8-1094-4a52-adf2-b2f5bc52836d service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] No waiting events found dispatching network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:11 user nova-compute[75006]: WARNING nova.compute.manager [req-f7ea608f-4d33-4f57-ac7f-1da892aca227 req-c4c6e3f8-1094-4a52-adf2-b2f5bc52836d service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received unexpected event network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 for instance with vm_state building and task_state spawning.
Nov 27 03:21:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-e41f7509-d54a-4861-9983-e1090430926c req-8af14cd1-2987-4c56-8a97-09d4798bbeea service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received event network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e41f7509-d54a-4861-9983-e1090430926c req-8af14cd1-2987-4c56-8a97-09d4798bbeea service nova] Acquiring lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e41f7509-d54a-4861-9983-e1090430926c req-8af14cd1-2987-4c56-8a97-09d4798bbeea service nova] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e41f7509-d54a-4861-9983-e1090430926c req-8af14cd1-2987-4c56-8a97-09d4798bbeea service nova] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-e41f7509-d54a-4861-9983-e1090430926c req-8af14cd1-2987-4c56-8a97-09d4798bbeea service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] No waiting events found dispatching network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:12 user nova-compute[75006]: WARNING nova.compute.manager [req-e41f7509-d54a-4861-9983-e1090430926c req-8af14cd1-2987-4c56-8a97-09d4798bbeea service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received unexpected event network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 for instance with vm_state building and task_state spawning.
Nov 27 03:21:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-ba596094-933d-425c-89ed-60e28b18bc05 req-aca26259-8d23-490b-84e7-002305a25bea service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ba596094-933d-425c-89ed-60e28b18bc05 req-aca26259-8d23-490b-84e7-002305a25bea service nova] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ba596094-933d-425c-89ed-60e28b18bc05 req-aca26259-8d23-490b-84e7-002305a25bea service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ba596094-933d-425c-89ed-60e28b18bc05 req-aca26259-8d23-490b-84e7-002305a25bea service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-ba596094-933d-425c-89ed-60e28b18bc05 req-aca26259-8d23-490b-84e7-002305a25bea service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] No waiting events found dispatching network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:13 user nova-compute[75006]: WARNING nova.compute.manager [req-ba596094-933d-425c-89ed-60e28b18bc05 req-aca26259-8d23-490b-84e7-002305a25bea service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received unexpected event network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 for instance with vm_state building and task_state spawning.
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:21:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Instance spawned successfully.
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: INFO nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:14 user nova-compute[75006]: INFO nova.compute.manager [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Took 7.81 seconds to build instance.
Nov 27 03:21:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e638d89-5da4-47d4-a2b0-48c46650fd07 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.913s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:21:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Instance spawned successfully.
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:21:14 user nova-compute[75006]: INFO nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-daa51261-e88d-4cb7-ac1c-7acd81e568bf req-3ddea923-4286-40b2-8487-eddc6477eabb service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received event network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-daa51261-e88d-4cb7-ac1c-7acd81e568bf req-3ddea923-4286-40b2-8487-eddc6477eabb service nova] Acquiring lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-daa51261-e88d-4cb7-ac1c-7acd81e568bf req-3ddea923-4286-40b2-8487-eddc6477eabb service nova] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-daa51261-e88d-4cb7-ac1c-7acd81e568bf req-3ddea923-4286-40b2-8487-eddc6477eabb service nova] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-daa51261-e88d-4cb7-ac1c-7acd81e568bf req-3ddea923-4286-40b2-8487-eddc6477eabb service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] No waiting events found dispatching network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:14 user nova-compute[75006]: WARNING nova.compute.manager [req-daa51261-e88d-4cb7-ac1c-7acd81e568bf req-3ddea923-4286-40b2-8487-eddc6477eabb service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received unexpected event network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 for instance with vm_state building and task_state spawning.
Nov 27 03:21:14 user nova-compute[75006]: INFO nova.compute.manager [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Took 7.08 seconds to build instance.
Nov 27 03:21:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e19b9393-6530-4d23-b3bc-7caf2d824915 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.187s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:20 user nova-compute[75006]: INFO nova.compute.manager [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Terminating instance
Nov 27 03:21:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:21:20 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 is timed out.
Nov 27 03:21:20 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Successfully detached device vdb from instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 from the live domain config.
Nov 27 03:21:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbzHwmhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'fe428d41-58e9-4036-a448-50de57a0b833'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:21:20 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efe97bc-9914-4ea9-99a4-6a436e0609ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:21:20 user nova-compute[75006]: No targets found.
Nov 27 03:21:20 user nova-compute[75006]: iSNS:
Nov 27 03:21:20 user nova-compute[75006]: No targets found.
Nov 27 03:21:20 user nova-compute[75006]: STATIC:
Nov 27 03:21:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d
Nov 27 03:21:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:21:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:21:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:21:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:21:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:21:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833
Nov 27 03:21:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:21:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:21:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:21:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:21:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:21:20 user nova-compute[75006]: FIRMWARE:
Nov 27 03:21:20 user nova-compute[75006]: No targets found.
Nov 27 03:21:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:21:20 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:21:20 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d93fed-7dfe-4ad4-abeb-716d0976b7c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b7e36b-388c-402d-8d25-8548e8d4ec10]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:20 user nova-compute[75006]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:21:20 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:20 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:20 user nova-compute[75006]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 (non-flash)
Nov 27 03:21:20 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:20 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c1ea290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833'): ({'sdc'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Removing single pathed devices sdc {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc14612d-90d1-445d-90be-d2b78b74ef9c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5724a397-65d9-4d62-9bb1-09bb73cc2262]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Flushing IO for device /dev/sdc {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d601cfa4-8812-4d9e-9844-2c55ad5150e8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9648a912-7372-4761-8778-190149d56569]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[84374959-16df-4548-a17d-c55975f478b3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36059e5-5a36-4367-9ef7-fbd911ecbde1]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260]
Nov 27 03:21:20 user nova-compute[75006]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833, portal: 172.16.0.220,3260] successful.
Nov 27 03:21:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe428d41-58e9-4036-a448-50de57a0b833 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[af153b06-9e24-4823-9324-930de6c4c0f6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] <== disconnect_volume: return (382ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-75854d15-7ad4-47ab-8122-24019a6532cc req-0b538fb5-bab4-4d9f-857b-23d5e898b2e1 service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received event network-vif-unplugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-75854d15-7ad4-47ab-8122-24019a6532cc req-0b538fb5-bab4-4d9f-857b-23d5e898b2e1 service nova] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-75854d15-7ad4-47ab-8122-24019a6532cc req-0b538fb5-bab4-4d9f-857b-23d5e898b2e1 service nova] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-75854d15-7ad4-47ab-8122-24019a6532cc req-0b538fb5-bab4-4d9f-857b-23d5e898b2e1 service nova] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-75854d15-7ad4-47ab-8122-24019a6532cc req-0b538fb5-bab4-4d9f-857b-23d5e898b2e1 service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] No waiting events found dispatching network-vif-unplugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-75854d15-7ad4-47ab-8122-24019a6532cc req-0b538fb5-bab4-4d9f-857b-23d5e898b2e1 service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received event network-vif-unplugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:21:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Instance destroyed successfully.
Nov 27 03:21:21 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lazy-loading 'resources' on Instance uuid 8192463c-0589-4a75-97ec-24a5d9149c7f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1949820348',display_name='tempest-VolumesAssistedSnapshotsTest-server-1949820348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1949820348',id=9,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkkCUNGzotbAQ1sr/JVoPSaU89h6r7/r256Dz4phDCYNkfNiJGyEKNvLbMioHxLIeCWaC/7d7GZrOOM5NBVID4T4/GggyWdnFQhnVJuZF7OK0G6fOjIIQAGsWlBLbD/cA==',key_name='tempest-keypair-44339890',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e04dbb8754014588af0a6d6f9582640e',ramdisk_id='',reservation_id='r-h7o30y6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-381108971',owner_user_name='tempest-VolumesAssistedSnapshotsTest-381108971-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:18:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2910ee7024114ce0a0a86ca217aa64ed',uuid=8192463c-0589-4a75-97ec-24a5d9149c7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Converting VIF {"id": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "address": "fa:16:3e:fd:57:68", "network": {"id": "439014dd-9312-44d9-90b0-15d9370c0d23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2028176735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e04dbb8754014588af0a6d6f9582640e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b14e158-9b", "ovs_interfaceid": "7b14e158-9ba1-4ca2-945c-fd79fe5f3452", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:57:68,bridge_name='br-int',has_traffic_filtering=True,id=7b14e158-9ba1-4ca2-945c-fd79fe5f3452,network=Network(439014dd-9312-44d9-90b0-15d9370c0d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b14e158-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG os_vif [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:57:68,bridge_name='br-int',has_traffic_filtering=True,id=7b14e158-9ba1-4ca2-945c-fd79fe5f3452,network=Network(439014dd-9312-44d9-90b0-15d9370c0d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b14e158-9b') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b14e158-9b, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3f21a21-0da5-4eef-bc6f-4dda81f265e8) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:21 user nova-compute[75006]: INFO os_vif [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:57:68,bridge_name='br-int',has_traffic_filtering=True,id=7b14e158-9ba1-4ca2-945c-fd79fe5f3452,network=Network(439014dd-9312-44d9-90b0-15d9370c0d23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b14e158-9b')
Nov 27 03:21:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Deleting instance files /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f_del
Nov 27 03:21:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Deletion of /opt/stack/data/nova/instances/8192463c-0589-4a75-97ec-24a5d9149c7f_del complete
Nov 27 03:21:21 user nova-compute[75006]: INFO nova.compute.manager [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 03:21:21 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lazy-loading 'flavor' on Instance uuid 78af3b73-bce3-4e4b-b040-eda0d6af7050 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7510e35e-3df5-4c7c-8b0b-9724a570056d tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.869s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:21 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:22 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Took 0.73 seconds to deallocate network for instance.
Nov 27 03:21:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:22 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Deleted allocations for instance 8192463c-0589-4a75-97ec-24a5d9149c7f
Nov 27 03:21:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8a63e9cb-d3eb-447d-9f67-77be7a60f9a4 tempest-VolumesAssistedSnapshotsTest-381108971 tempest-VolumesAssistedSnapshotsTest-381108971-project-member] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-cbf24598-e894-4ff9-ae9e-3355e78e0c79 req-b85e44c0-b10d-4bb4-8cf7-bfd8b33fafde service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received event network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cbf24598-e894-4ff9-ae9e-3355e78e0c79 req-b85e44c0-b10d-4bb4-8cf7-bfd8b33fafde service nova] Acquiring lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cbf24598-e894-4ff9-ae9e-3355e78e0c79 req-b85e44c0-b10d-4bb4-8cf7-bfd8b33fafde service nova] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cbf24598-e894-4ff9-ae9e-3355e78e0c79 req-b85e44c0-b10d-4bb4-8cf7-bfd8b33fafde service nova] Lock "8192463c-0589-4a75-97ec-24a5d9149c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-cbf24598-e894-4ff9-ae9e-3355e78e0c79 req-b85e44c0-b10d-4bb4-8cf7-bfd8b33fafde service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] No waiting events found dispatching network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:22 user nova-compute[75006]: WARNING nova.compute.manager [req-cbf24598-e894-4ff9-ae9e-3355e78e0c79 req-b85e44c0-b10d-4bb4-8cf7-bfd8b33fafde service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received unexpected event network-vif-plugged-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 for instance with vm_state deleted and task_state None.
Nov 27 03:21:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-cbf24598-e894-4ff9-ae9e-3355e78e0c79 req-b85e44c0-b10d-4bb4-8cf7-bfd8b33fafde service nova] [instance: 8192463c-0589-4a75-97ec-24a5d9149c7f] Received event network-vif-deleted-7b14e158-9ba1-4ca2-945c-fd79fe5f3452 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:32 user nova-compute[75006]: INFO nova.compute.manager [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Terminating instance
Nov 27 03:21:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-f31f3559-3979-4092-b4db-ba9358b9cb56 req-0df6915f-e78c-4f55-87e9-371d67108ed3 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received event network-vif-unplugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f31f3559-3979-4092-b4db-ba9358b9cb56 req-0df6915f-e78c-4f55-87e9-371d67108ed3 service nova] Acquiring lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f31f3559-3979-4092-b4db-ba9358b9cb56 req-0df6915f-e78c-4f55-87e9-371d67108ed3 service nova] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f31f3559-3979-4092-b4db-ba9358b9cb56 req-0df6915f-e78c-4f55-87e9-371d67108ed3 service nova] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-f31f3559-3979-4092-b4db-ba9358b9cb56 req-0df6915f-e78c-4f55-87e9-371d67108ed3 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] No waiting events found dispatching network-vif-unplugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-f31f3559-3979-4092-b4db-ba9358b9cb56 req-0df6915f-e78c-4f55-87e9-371d67108ed3 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received event network-vif-unplugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:21:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Instance destroyed successfully.
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lazy-loading 'resources' on Instance uuid 3dd80363-c3bb-42ea-8ea5-ab23526fd395 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1833879037',display_name='tempest-ServersNegativeTestJSON-server-1833879037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1833879037',id=13,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:19:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ca85c0868b6468fb2a3025ccd562f91',ramdisk_id='',reservation_id='r-k01uynyc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-809508397',owner_user_name='tempest-ServersNegativeTestJSON-809508397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:19:49Z,user_data=None,user_id='b5489e0f1a5c4bb1896c89ffaed79d77',uuid=3dd80363-c3bb-42ea-8ea5-ab23526fd395,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converting VIF {"id": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "address": "fa:16:3e:65:81:40", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3b07ec1-f4", "ovs_interfaceid": "b3b07ec1-f48e-4536-bd16-b1fb42a0878a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:81:40,bridge_name='br-int',has_traffic_filtering=True,id=b3b07ec1-f48e-4536-bd16-b1fb42a0878a,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b07ec1-f4') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG os_vif [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:81:40,bridge_name='br-int',has_traffic_filtering=True,id=b3b07ec1-f48e-4536-bd16-b1fb42a0878a,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b07ec1-f4') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3b07ec1-f4, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35471f39-314d-444b-9ebf-be1fd650a407) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:33 user nova-compute[75006]: INFO os_vif [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:81:40,bridge_name='br-int',has_traffic_filtering=True,id=b3b07ec1-f48e-4536-bd16-b1fb42a0878a,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3b07ec1-f4')
Nov 27 03:21:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Deleting instance files /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395_del
Nov 27 03:21:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Deletion of /opt/stack/data/nova/instances/3dd80363-c3bb-42ea-8ea5-ab23526fd395_del complete
Nov 27 03:21:33 user nova-compute[75006]: INFO nova.compute.manager [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 03:21:33 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:33 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Took 0.39 seconds to deallocate network for instance.
Nov 27 03:21:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:21:33 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:21:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:34 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Deleted allocations for instance 3dd80363-c3bb-42ea-8ea5-ab23526fd395
Nov 27 03:21:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d69db1-2a78-4d5e-8b9b-3ee57dafe6b9 tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-f92a88ea-4591-4236-beac-811ff88c5801 req-c9c48e4a-7a9d-47d9-a9d8-5e31394bc4a1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received event network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f92a88ea-4591-4236-beac-811ff88c5801 req-c9c48e4a-7a9d-47d9-a9d8-5e31394bc4a1 service nova] Acquiring lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f92a88ea-4591-4236-beac-811ff88c5801 req-c9c48e4a-7a9d-47d9-a9d8-5e31394bc4a1 service nova] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f92a88ea-4591-4236-beac-811ff88c5801 req-c9c48e4a-7a9d-47d9-a9d8-5e31394bc4a1 service nova] Lock "3dd80363-c3bb-42ea-8ea5-ab23526fd395-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-f92a88ea-4591-4236-beac-811ff88c5801 req-c9c48e4a-7a9d-47d9-a9d8-5e31394bc4a1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] No waiting events found dispatching network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:34 user nova-compute[75006]: WARNING nova.compute.manager [req-f92a88ea-4591-4236-beac-811ff88c5801 req-c9c48e4a-7a9d-47d9-a9d8-5e31394bc4a1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received unexpected event network-vif-plugged-b3b07ec1-f48e-4536-bd16-b1fb42a0878a for instance with vm_state deleted and task_state None.
Nov 27 03:21:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-f92a88ea-4591-4236-beac-811ff88c5801 req-c9c48e4a-7a9d-47d9-a9d8-5e31394bc4a1 service nova] [instance: 3dd80363-c3bb-42ea-8ea5-ab23526fd395] Received event network-vif-deleted-b3b07ec1-f48e-4536-bd16-b1fb42a0878a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:40 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:21:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'flavor' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:42 user nova-compute[75006]: INFO nova.compute.manager [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Attaching volume f0ba20c6-f7b4-4313-bd00-ebcf3293b469 to /dev/vdb
Nov 27 03:21:42 user nova-compute[75006]: DEBUG os_brick.utils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ace4f1-fed4-42eb-a159-ad02952dfaef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2abfbff-ca47-4242-8d00-f04bfd97718c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d31268a-2194-4648-bcac-927fd8d824da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6be9565-0a9d-48ce-b36c-eae27e576086]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:21:42 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:21:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b47cb0-63bf-4514-8927-62169760ec88]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG os_brick.utils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:21:42 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating existing volume attachment record: cdbc5027-cc4d-4fb3-9030-aa14a50fe184 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:21:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:43 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:21:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=25.537742614746094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fd992ae2-0b97-47d2-9e03-f707af65f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5ee0634e-e918-4e98-a42c-496e3f7de095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 78af3b73-bce3-4e4b-b040-eda0d6af7050 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 503a960f-c3f6-4b8f-af89-7796916be32c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance f6c29a59-34d3-4aa9-8c87-447f0b3a0f74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 7b4d808c-beca-4008-8733-31afc9b26d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e1b3e5d0-c175-42e0-bf86-79839548aadf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:21:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXncGkvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:21:49 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:21:49 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:21:49 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9a9944-59ab-4c81-bcd5-d2d3766538cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:21:49 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca019b4-fbbb-4940-9e8e-0d449188eefb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469] added
Nov 27 03:21:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa04ca9e-c2e8-427c-90dd-b45391591ba6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca6cdce-6816-42f5-89b4-0efb9179ee74]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXncGkvF {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXncGkvF" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652a0c4-2405-45c0-91d7-06034a00ea23]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXncGkvF'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232ee42-b167-4946-bca0-2a8d830269a2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8b9e13-95d8-4d8d-8bcf-0c88b0a6b1d7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[22db61a6-775f-452f-ab81-f9a5db14dccf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469, portal: 172.16.0.220,3260]
Nov 27 03:21:49 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469, portal: 172.16.0.220,3260] successful.
Nov 27 03:21:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[533c8971-b0d3-459f-a7de-a592af0857df]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2324f5-19da-451c-b41c-6759ca2bae3e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:49 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa1c4a1-3bca-4d07-aa42-ee08f1b75733]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:21:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXncGkvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:50 user nova-compute[75006]: INFO nova.compute.manager [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Terminating instance
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23639633430386337', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639633430386337', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.objects.instance [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'flavor' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Instance destroyed successfully.
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.objects.instance [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lazy-loading 'resources' on Instance uuid 78af3b73-bce3-4e4b-b040-eda0d6af7050 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1324214563',display_name='tempest-TestVolumeSwap-server-1324214563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1324214563',id=8,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxtE4mKi8PFBXEO5JbRPT7BdXh2Jg+9OpJ/dw+rbmCtpJjlMAc0zcKzsNto0pPq7h/J8awJw6bRf2U9fcMiDLeBMTDnGBbWzw8dtEb5Kqn8UnVqIQMpiYeGeLm+sar3yg==',key_name='tempest-keypair-474088198',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d20b627f97e45c7aa1a3d3fd7dc9960',ramdisk_id='',reservation_id='r-cnilo01a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-562406576',owner_user_name='tempest-TestVolumeSwap-562406576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:18:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f84f6eae3fb74663ae52855de33ef727',uuid=78af3b73-bce3-4e4b-b040-eda0d6af7050,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Converting VIF {"id": "84c13471-a593-4bf7-892c-caafa75901a4", "address": "fa:16:3e:29:8f:68", "network": {"id": "74d37221-e174-4385-aa63-0ee8a5f3415a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1158133998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d20b627f97e45c7aa1a3d3fd7dc9960", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c13471-a5", "ovs_interfaceid": "84c13471-a593-4bf7-892c-caafa75901a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:8f:68,bridge_name='br-int',has_traffic_filtering=True,id=84c13471-a593-4bf7-892c-caafa75901a4,network=Network(74d37221-e174-4385-aa63-0ee8a5f3415a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c13471-a5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG os_vif [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:8f:68,bridge_name='br-int',has_traffic_filtering=True,id=84c13471-a593-4bf7-892c-caafa75901a4,network=Network(74d37221-e174-4385-aa63-0ee8a5f3415a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c13471-a5') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c13471-a5, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:21:50 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:21:50 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:21:50 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:21:50 user nova-compute[75006]:   <serial>f0ba20c6-f7b4-4313-bd00-ebcf3293b469</serial>
Nov 27 03:21:50 user nova-compute[75006]: </disk>
Nov 27 03:21:50 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=feb36201-47fe-493e-b6a6-09b67f433008) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:51 user nova-compute[75006]: INFO os_vif [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:8f:68,bridge_name='br-int',has_traffic_filtering=True,id=84c13471-a593-4bf7-892c-caafa75901a4,network=Network(74d37221-e174-4385-aa63-0ee8a5f3415a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c13471-a5')
Nov 27 03:21:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Deleting instance files /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050_del
Nov 27 03:21:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Deletion of /opt/stack/data/nova/instances/78af3b73-bce3-4e4b-b040-eda0d6af7050_del complete
Nov 27 03:21:51 user nova-compute[75006]: INFO nova.compute.manager [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 03:21:51 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No VIF found with MAC fa:16:3e:8f:6e:07, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-96d480e0-81a5-417b-b045-a3ffaaa8d46f tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.945s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:51 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Took 0.82 seconds to deallocate network for instance.
Nov 27 03:21:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-b26f95d5-5048-4700-801b-9b23ce5a2c38 req-745fd38c-212d-42a4-8a48-09579fc06016 service nova] [instance: 78af3b73-bce3-4e4b-b040-eda0d6af7050] Received event network-vif-deleted-84c13471-a593-4bf7-892c-caafa75901a4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updating instance_info_cache with network_info: [{"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-5ee0634e-e918-4e98-a42c-496e3f7de095" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:52 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Deleted allocations for instance 78af3b73-bce3-4e4b-b040-eda0d6af7050
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-43050b78-1495-41ef-ad9d-a13f8809fe88 tempest-TestVolumeSwap-562406576 tempest-TestVolumeSwap-562406576-project-member] Lock "78af3b73-bce3-4e4b-b040-eda0d6af7050" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:52 user nova-compute[75006]: INFO nova.compute.manager [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Rescuing
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquired lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG nova.network.neutron [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:21:52 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquired lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'info_cache' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.objects.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Releasing lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Releasing lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:21:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance destroyed successfully.
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'resources' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.objects.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_vif [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f7e81ab-18, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d00af53-a923-45c4-8013-6056a5588bdc) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: INFO os_vif [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18')
Nov 27 03:21:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJYKSaHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:21:53 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa06473d-7d7e-4e04-ac66-d5de36730e27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:21:53 user nova-compute[75006]: No targets found.
Nov 27 03:21:53 user nova-compute[75006]: iSNS:
Nov 27 03:21:53 user nova-compute[75006]: No targets found.
Nov 27 03:21:53 user nova-compute[75006]: STATIC:
Nov 27 03:21:53 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469
Nov 27 03:21:53 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:21:53 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:21:53 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d
Nov 27 03:21:53 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:21:53 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:21:53 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:21:53 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:21:53 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:21:53 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:21:53 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:21:53 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:21:53 user nova-compute[75006]: FIRMWARE:
Nov 27 03:21:53 user nova-compute[75006]: No targets found.
Nov 27 03:21:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:21:53 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:21:53 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[320beb06-b146-4ed3-b80c-c7cafe40a836]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7686c0ce-6631-4549-bdbe-29feaa50e084]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:53 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:53 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:53 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:53 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:53 user nova-compute[75006]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:53 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4482e3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231'): ({'sdf'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Removing single pathed devices sdf {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c356a102-9ddb-4ade-bf96-51fb5fbbe23b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32a0121-bd68-4757-9547-716c9c981298]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flushing IO for device /dev/sdf {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3489680-2c9e-4fe2-be51-363aea488519]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:21:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.061s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e863d2-ee13-4a04-8971-ed4f8f209f8c]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] SCSI volumes sdf have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-361ed762-ffc2-477c-924f-ba2b6c394784 req-5d010c22-4841-418a-a961-1b5bbd28d809 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-361ed762-ffc2-477c-924f-ba2b6c394784 req-5d010c22-4841-418a-a961-1b5bbd28d809 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-361ed762-ffc2-477c-924f-ba2b6c394784 req-5d010c22-4841-418a-a961-1b5bbd28d809 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-361ed762-ffc2-477c-924f-ba2b6c394784 req-5d010c22-4841-418a-a961-1b5bbd28d809 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-361ed762-ffc2-477c-924f-ba2b6c394784 req-5d010c22-4841-418a-a961-1b5bbd28d809 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:54 user nova-compute[75006]: WARNING nova.compute.manager [req-361ed762-ffc2-477c-924f-ba2b6c394784 req-5d010c22-4841-418a-a961-1b5bbd28d809 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state active and task_state rescuing.
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aba9f9c-0882-4f28-8799-497c154def9f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5e1e54-c9a5-41fb-9eca-43c8d443601d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260]
Nov 27 03:21:54 user nova-compute[75006]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260] successful.
Nov 27 03:21:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac17e6-d853-4727-8d09-e0be70b5bdbf]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== disconnect_volume: return (388ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Start _get_guest_xml network_info=[{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '8474d88a-1382-4737-9d63-32727bb6587a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJYKSaHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '70a4bf10-12f0-4b99-baa2-53be7becbb21', 'attached_at': '', 'detached_at': '', 'volume_id': '2500f817-c1b9-4704-b404-22a17c6a0231', 'serial': '2500f817-c1b9-4704-b404-22a17c6a0231'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'numa_topology' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.objects.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:54 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:54 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'vcpu_model' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.objects.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJYKSaHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:21:54 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:21:54 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:21:54 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[503d728e-ec65-4890-9f13-a03a7e235f8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:21:54 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[32afdb62-38de-436c-9047-f491a6657b1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231] added
Nov 27 03:21:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6235011-31be-41a0-a5b7-2e24da953cd1]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44ff85f-4c33-40c0-82fa-53e5058f13ab]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJYKSaHO {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJYKSaHO" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[827a9d85-239d-4dbc-9adb-831efa0889f8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kJYKSaHO'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c0fbea-fe2b-494f-858f-5a81fa24c9cc]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[00332bdd-e836-4d50-ac4f-43e228bd6c73]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4590ab-ba29-4969-a64e-b02c3df1be67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260]
Nov 27 03:21:54 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260] successful.
Nov 27 03:21:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d453478e-e064-4030-9a45-8284629049c9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance destroyed successfully.
Nov 27 03:21:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Attempting a stable device rescue
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9420073a-eef7-4611-a28c-f125f82c8eab]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:54 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a3007e-094a-4924-a3c6-f14292be454e]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJYKSaHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75006) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance directory exists: not creating {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 03:21:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Creating image(s)
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG nova.objects.instance [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "b8ac6bcf34ac0fac07580ea3032488f6d4a68a84" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "b8ac6bcf34ac0fac07580ea3032488f6d4a68a84" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '26434623035353437', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434623035353437', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'pci_devices' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.objects.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:21:55 user nova-compute[75006]:   <uuid>70a4bf10-12f0-4b99-baa2-53be7becbb21</uuid>
Nov 27 03:21:55 user nova-compute[75006]:   <name>instance-00000003</name>
Nov 27 03:21:55 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:21:55 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:21:55 user nova-compute[75006]:   <metadata>
Nov 27 03:21:55 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:21:55 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:21:55 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeTestJSON-server-1573842622</nova:name>
Nov 27 03:21:55 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:21:54</nova:creationTime>
Nov 27 03:21:55 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:21:55 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:21:55 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:21:55 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:21:55 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:21:55 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:21:55 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:21:55 user nova-compute[75006]:       <nova:owner>
Nov 27 03:21:55 user nova-compute[75006]:         <nova:user uuid="1275432e762e409d92b00e7c3303de53">tempest-AttachVolumeTestJSON-245260319-project-member</nova:user>
Nov 27 03:21:55 user nova-compute[75006]:         <nova:project uuid="9c41971e35b24517acd8b84a22e14b97">tempest-AttachVolumeTestJSON-245260319</nova:project>
Nov 27 03:21:55 user nova-compute[75006]:       </nova:owner>
Nov 27 03:21:55 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:21:55 user nova-compute[75006]:       <nova:ports>
Nov 27 03:21:55 user nova-compute[75006]:         <nova:port uuid="1f7e81ab-1878-407b-a8fe-02ea2918ff76">
Nov 27 03:21:55 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 03:21:55 user nova-compute[75006]:         </nova:port>
Nov 27 03:21:55 user nova-compute[75006]:       </nova:ports>
Nov 27 03:21:55 user nova-compute[75006]:     </nova:instance>
Nov 27 03:21:55 user nova-compute[75006]:   </metadata>
Nov 27 03:21:55 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:21:55 user nova-compute[75006]:     <system>
Nov 27 03:21:55 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:21:55 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:21:55 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:21:55 user nova-compute[75006]:       <entry name="serial">70a4bf10-12f0-4b99-baa2-53be7becbb21</entry>
Nov 27 03:21:55 user nova-compute[75006]:       <entry name="uuid">70a4bf10-12f0-4b99-baa2-53be7becbb21</entry>
Nov 27 03:21:55 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:21:55 user nova-compute[75006]:     </system>
Nov 27 03:21:55 user nova-compute[75006]:   </sysinfo>
Nov 27 03:21:55 user nova-compute[75006]:   <os>
Nov 27 03:21:55 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:21:55 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:21:55 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:21:55 user nova-compute[75006]:   </os>
Nov 27 03:21:55 user nova-compute[75006]:   <features>
Nov 27 03:21:55 user nova-compute[75006]:     <acpi/>
Nov 27 03:21:55 user nova-compute[75006]:     <apic/>
Nov 27 03:21:55 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:21:55 user nova-compute[75006]:   </features>
Nov 27 03:21:55 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:21:55 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:21:55 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:21:55 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:21:55 user nova-compute[75006]:   </clock>
Nov 27 03:21:55 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:21:55 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:21:55 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:21:55 user nova-compute[75006]:   </cpu>
Nov 27 03:21:55 user nova-compute[75006]:   <devices>
Nov 27 03:21:55 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:21:55 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:21:55 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk"/>
Nov 27 03:21:55 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:21:55 user nova-compute[75006]:     </disk>
Nov 27 03:21:55 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:21:55 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:21:55 user nova-compute[75006]:       <source dev="/dev/sdd"/>
Nov 27 03:21:55 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:21:55 user nova-compute[75006]:       <serial>2500f817-c1b9-4704-b404-22a17c6a0231</serial>
Nov 27 03:21:55 user nova-compute[75006]:     </disk>
Nov 27 03:21:55 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:21:55 user nova-compute[75006]:       <mac address="fa:16:3e:1a:de:2b"/>
Nov 27 03:21:55 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:21:55 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:21:55 user nova-compute[75006]:       <target dev="tap1f7e81ab-18"/>
Nov 27 03:21:55 user nova-compute[75006]:     </interface>
Nov 27 03:21:55 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:21:55 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/console.log" append="off"/>
Nov 27 03:21:55 user nova-compute[75006]:     </serial>
Nov 27 03:21:55 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:21:55 user nova-compute[75006]:     <video>
Nov 27 03:21:55 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:21:55 user nova-compute[75006]:     </video>
Nov 27 03:21:55 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:21:55 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:21:55 user nova-compute[75006]:     </rng>
Nov 27 03:21:55 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:21:55 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:21:55 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:21:55 user nova-compute[75006]:     </memballoon>
Nov 27 03:21:55 user nova-compute[75006]:   </devices>
Nov 27 03:21:55 user nova-compute[75006]: </domain>
Nov 27 03:21:55 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.virt.images [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] 5e8ed08f-2667-416d-bfb7-884ed32e7a1d was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84.part /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-a03d2b12-aae7-40d0-818f-0ca2a2775d97 req-f2476370-00a9-48ac-bdfe-8f24bb836b3d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received event network-changed-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-a03d2b12-aae7-40d0-818f-0ca2a2775d97 req-f2476370-00a9-48ac-bdfe-8f24bb836b3d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Refreshing instance network info cache due to event network-changed-1e445a88-b315-40e5-824c-f937bb4e4c97. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a03d2b12-aae7-40d0-818f-0ca2a2775d97 req-f2476370-00a9-48ac-bdfe-8f24bb836b3d service nova] Acquiring lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a03d2b12-aae7-40d0-818f-0ca2a2775d97 req-f2476370-00a9-48ac-bdfe-8f24bb836b3d service nova] Acquired lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-a03d2b12-aae7-40d0-818f-0ca2a2775d97 req-f2476370-00a9-48ac-bdfe-8f24bb836b3d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Refreshing network info cache for port 1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-0ca3c3db-91dc-4792-8db8-d890db464e9c req-205972bc-a96d-4bcd-b7c1-74a2efc42c1c service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0ca3c3db-91dc-4792-8db8-d890db464e9c req-205972bc-a96d-4bcd-b7c1-74a2efc42c1c service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0ca3c3db-91dc-4792-8db8-d890db464e9c req-205972bc-a96d-4bcd-b7c1-74a2efc42c1c service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0ca3c3db-91dc-4792-8db8-d890db464e9c req-205972bc-a96d-4bcd-b7c1-74a2efc42c1c service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-0ca3c3db-91dc-4792-8db8-d890db464e9c req-205972bc-a96d-4bcd-b7c1-74a2efc42c1c service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:56 user nova-compute[75006]: WARNING nova.compute.manager [req-0ca3c3db-91dc-4792-8db8-d890db464e9c req-205972bc-a96d-4bcd-b7c1-74a2efc42c1c service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state active and task_state rescuing.
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'trusted_certs' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.objects.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84.part /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84.converted" returned: 0 in 0.577s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:56 user nova-compute[75006]: INFO nova.compute.manager [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Terminating instance
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Cannot resize image /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'migration_context' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.objects.base [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG os_vif [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f256d33d-da2b-5e53-ab9a-c99eba3c2511', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84.converted --force-share --output=json" returned: 0 in 0.292s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "b8ac6bcf34ac0fac07580ea3032488f6d4a68a84" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.165s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "b8ac6bcf34ac0fac07580ea3032488f6d4a68a84" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "b8ac6bcf34ac0fac07580ea3032488f6d4a68a84" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84 --force-share --output=json" returned: 0 in 0.295s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84,backing_fmt=raw /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.rescue {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f7e81ab-18, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f7e81ab-18, col_values=(('qos', UUID('39630b99-3411-475a-940f-1810df380c45')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f7e81ab-18, col_values=(('external_ids', {'iface-id': '1f7e81ab-1878-407b-a8fe-02ea2918ff76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:de:2b', 'vm-uuid': '70a4bf10-12f0-4b99-baa2-53be7becbb21'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:57 user nova-compute[75006]: INFO os_vif [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18')
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-a03d2b12-aae7-40d0-818f-0ca2a2775d97 req-f2476370-00a9-48ac-bdfe-8f24bb836b3d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Updated VIF entry in instance network info cache for port 1e445a88-b315-40e5-824c-f937bb4e4c97. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-a03d2b12-aae7-40d0-818f-0ca2a2775d97 req-f2476370-00a9-48ac-bdfe-8f24bb836b3d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Updating instance_info_cache with network_info: [{"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84,backing_fmt=raw /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.rescue" returned: 0 in 0.482s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "b8ac6bcf34ac0fac07580ea3032488f6d4a68a84" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.785s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.objects.instance [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'migration_context' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.objects.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Object Instance<fa069296-0bb8-4b82-bedf-d1a8d8cd104e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Start _get_guest_xml network_info=[{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "vif_mac": "fa:16:3e:8f:6e:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5e8ed08f-2667-416d-bfb7-884ed32e7a1d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'cdbc5027-cc4d-4fb3-9030-aa14a50fe184', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXncGkvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fa069296-0bb8-4b82-bedf-d1a8d8cd104e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0ba20c6-f7b4-4313-bd00-ebcf3293b469', 'serial': 'f0ba20c6-f7b4-4313-bd00-ebcf3293b469'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.objects.instance [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'resources' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a03d2b12-aae7-40d0-818f-0ca2a2775d97 req-f2476370-00a9-48ac-bdfe-8f24bb836b3d service nova] Releasing lock "refresh_cache-f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.objects.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Object Instance<fa069296-0bb8-4b82-bedf-d1a8d8cd104e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.objects.instance [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'numa_topology' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.objects.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Object Instance<fa069296-0bb8-4b82-bedf-d1a8d8cd104e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:57 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:57 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.objects.instance [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.objects.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Object Instance<fa069296-0bb8-4b82-bedf-d1a8d8cd104e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXncGkvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:21:57 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:21:57 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:21:57 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260" returned: 0 in 0.037s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63a57a7-8994-472a-9477-3b91f2150258]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pXncGkvF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 03:21:57 user nova-compute[75006]: node.name = iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469
Nov 27 03:21:57 user nova-compute[75006]: node.tpgt = -1
Nov 27 03:21:57 user nova-compute[75006]: node.startup = automatic
Nov 27 03:21:57 user nova-compute[75006]: node.leading_login = No
Nov 27 03:21:57 user nova-compute[75006]: iface.iscsi_ifacename = default
Nov 27 03:21:57 user nova-compute[75006]: iface.net_ifacename = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.ipaddress = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.prefix_len = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.hwaddress = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.transport_name = tcp
Nov 27 03:21:57 user nova-compute[75006]: iface.initiatorname = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.state = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.vlan_id = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.vlan_priority = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.vlan_state = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.iface_num = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.mtu = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.port = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.bootproto = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.subnet_mask = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.gateway = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.dhcp_alt_client_id = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.dhcp_dns = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.dhcp_learn_iqn = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.dhcp_vendor_id_state = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.dhcp_vendor_id = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.dhcp_slp_da = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.fragmentation = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.gratuitous_arp = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.incoming_forwarding = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.tos_state = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.tos = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.ttl = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.delayed_ack = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.tcp_nagle = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.tcp_wsf_state = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.tcp_wsf = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.tcp_timer_scale = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.tcp_timestamp = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.redirect = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.def_task_mgmt_timeout = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.header_digest = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.data_digest = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.immediate_data = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.initial_r2t = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.data_seq_inorder = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.data_pdu_inorder = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.erl = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.max_receive_data_len = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.first_burst_len = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.max_outstanding_r2t = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.max_burst_len = 0
Nov 27 03:21:57 user nova-compute[75006]: iface.chap_auth = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.bidi_chap = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.strict_login_compliance = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.discovery_auth = <empty>
Nov 27 03:21:57 user nova-compute[75006]: iface.discovery_logout = <empty>
Nov 27 03:21:57 user nova-compute[75006]: node.discovery_address = <empty>
Nov 27 03:21:57 user nova-compute[75006]: node.discovery_port = 0
Nov 27 03:21:57 user nova-compute[75006]: node.discovery_type = static
Nov 27 03:21:57 user nova-compute[75006]: node.session.initial_cmdsn = 0
Nov 27 03:21:57 user nova-compute[75006]: node.session.initial_login_retry_max = 8
Nov 27 03:21:57 user nova-compute[75006]: node.session.xmit_thread_priority = -20
Nov 27 03:21:57 user nova-compute[75006]: node.session.cmds_max = 128
Nov 27 03:21:57 user nova-compute[75006]: node.session.queue_depth = 32
Nov 27 03:21:57 user nova-compute[75006]: node.session.nr_sessions = 1
Nov 27 03:21:57 user nova-compute[75006]: node.session.auth.authmethod = CHAP
Nov 27 03:21:57 user nova-compute[75006]: node.session.auth.username = pXncGkvF
Nov 27 03:21:57 user nova-compute[75006]: node.session.auth.password = ***
Nov 27 03:21:57 user nova-compute[75006]: node.session.auth.username_in = <empty>
Nov 27 03:21:57 user nova-compute[75006]: node.session.auth.password_in = <empty>
Nov 27 03:21:57 user nova-compute[75006]: node.session.auth.chap_algs = MD5
Nov 27 03:21:57 user nova-compute[75006]: node.session.timeo.replacement_timeout = 120
Nov 27 03:21:57 user nova-compute[75006]: node.session.err_timeo.abort_timeout = 15
Nov 27 03:21:57 user nova-compute[75006]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 03:21:57 user nova-compute[75006]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 03:21:57 user nova-compute[75006]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.FastAbort = Yes
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.InitialR2T = No
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.ImmediateData = Yes
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.MaxConnections = 1
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 03:21:57 user nova-compute[75006]: node.session.iscsi.ERL = 0
Nov 27 03:21:57 user nova-compute[75006]: node.session.scan = manual
Nov 27 03:21:57 user nova-compute[75006]: node.session.reopen_max = 0
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].address = 172.16.0.220
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].port = 3260
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].startup = manual
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].tcp.window_size = 524288
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].tcp.type_of_service = 0
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].timeo.logout_timeout = 15
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].timeo.login_timeout = 15
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].timeo.auth_timeout = 45
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].iscsi.DataDigest = None
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].iscsi.IFMarker = No
Nov 27 03:21:57 user nova-compute[75006]: node.conn[0].iscsi.OFMarker = No
Nov 27 03:21:57 user nova-compute[75006]: # END RECORD
Nov 27 03:21:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b0b2c8-cd97-4584-b0f0-ba60b82e3600]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ca3a20-f3af-42ba-8d3b-55ddbd354b42]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXncGkvF {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:21:57 user nova-compute[75006]: INFO nova.compute.claims [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Claim successful on node user
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXncGkvF" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e0c2c-8354-4f71-b063-7b50fea47950]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXncGkvF'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ee4094-3cd3-47df-b8d1-d991fe33ffc4]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fadb449-4c10-481c-af37-55aa913d595f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:58 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:58 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:58 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:21:58 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:21:58 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:21:58 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:21:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.195s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d869a628-b6a3-4650-8f42-6bc1ad2c7292]: (4, ('0 0 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXncGkvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.224s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] <== connect_volume: return (225ms) {'type': 'block', 'scsi_wwn': '23639633430386337', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639633430386337', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-166334771',display_name='tempest-ServerStableDeviceRescueTest-server-166334771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-166334771',id=5,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkrvgso/+qYjDfRCrx5012kbek4Rd4RdwB6W/v4Ei54TxDnuJEm+BKPDOZU4Pzpb/hPvWhcT2lFjZjpaZ+X06ujo/JFr4LnGzCr1Fw0qFZv6B92syOK38/REaSqI9jAwg==',key_name='tempest-keypair-236960693',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfddf9022e8d4376ac00c17e04118132',ramdisk_id='',reservation_id='r-pfp5lkz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-303496041',owner_user_name='tempest-ServerStableDeviceRescueTest-303496041-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204e517cbd36494c94ee36e63da3acb6',uuid=fa069296-0bb8-4b82-bedf-d1a8d8cd104e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "vif_mac": "fa:16:3e:8f:6e:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Converting VIF {"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "vif_mac": "fa:16:3e:8f:6e:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:6e:07,bridge_name='br-int',has_traffic_filtering=True,id=f94812d5-e03a-40d6-88c1-6fe71880aa1d,network=Network(f054fb9a-ad51-4dc5-9d8e-531acafaad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94812d5-e0') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'pci_devices' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.objects.base [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Object Instance<fa069296-0bb8-4b82-bedf-d1a8d8cd104e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:21:58 user nova-compute[75006]:   <uuid>fa069296-0bb8-4b82-bedf-d1a8d8cd104e</uuid>
Nov 27 03:21:58 user nova-compute[75006]:   <name>instance-00000005</name>
Nov 27 03:21:58 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:21:58 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:21:58 user nova-compute[75006]:   <metadata>
Nov 27 03:21:58 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:21:58 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:21:58 user nova-compute[75006]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-166334771</nova:name>
Nov 27 03:21:58 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:21:57</nova:creationTime>
Nov 27 03:21:58 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:21:58 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:21:58 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:21:58 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:21:58 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:21:58 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:21:58 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:21:58 user nova-compute[75006]:       <nova:owner>
Nov 27 03:21:58 user nova-compute[75006]:         <nova:user uuid="204e517cbd36494c94ee36e63da3acb6">tempest-ServerStableDeviceRescueTest-303496041-project-member</nova:user>
Nov 27 03:21:58 user nova-compute[75006]:         <nova:project uuid="bfddf9022e8d4376ac00c17e04118132">tempest-ServerStableDeviceRescueTest-303496041</nova:project>
Nov 27 03:21:58 user nova-compute[75006]:       </nova:owner>
Nov 27 03:21:58 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:21:58 user nova-compute[75006]:       <nova:ports>
Nov 27 03:21:58 user nova-compute[75006]:         <nova:port uuid="f94812d5-e03a-40d6-88c1-6fe71880aa1d">
Nov 27 03:21:58 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 03:21:58 user nova-compute[75006]:         </nova:port>
Nov 27 03:21:58 user nova-compute[75006]:       </nova:ports>
Nov 27 03:21:58 user nova-compute[75006]:     </nova:instance>
Nov 27 03:21:58 user nova-compute[75006]:   </metadata>
Nov 27 03:21:58 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:21:58 user nova-compute[75006]:     <system>
Nov 27 03:21:58 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:21:58 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:21:58 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:21:58 user nova-compute[75006]:       <entry name="serial">fa069296-0bb8-4b82-bedf-d1a8d8cd104e</entry>
Nov 27 03:21:58 user nova-compute[75006]:       <entry name="uuid">fa069296-0bb8-4b82-bedf-d1a8d8cd104e</entry>
Nov 27 03:21:58 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:21:58 user nova-compute[75006]:     </system>
Nov 27 03:21:58 user nova-compute[75006]:   </sysinfo>
Nov 27 03:21:58 user nova-compute[75006]:   <os>
Nov 27 03:21:58 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:21:58 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:21:58 user nova-compute[75006]:   </os>
Nov 27 03:21:58 user nova-compute[75006]:   <features>
Nov 27 03:21:58 user nova-compute[75006]:     <acpi/>
Nov 27 03:21:58 user nova-compute[75006]:     <apic/>
Nov 27 03:21:58 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:21:58 user nova-compute[75006]:   </features>
Nov 27 03:21:58 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:21:58 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:21:58 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:21:58 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:21:58 user nova-compute[75006]:   </clock>
Nov 27 03:21:58 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:21:58 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:21:58 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:21:58 user nova-compute[75006]:   </cpu>
Nov 27 03:21:58 user nova-compute[75006]:   <devices>
Nov 27 03:21:58 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:21:58 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:21:58 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk"/>
Nov 27 03:21:58 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:21:58 user nova-compute[75006]:     </disk>
Nov 27 03:21:58 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:21:58 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:21:58 user nova-compute[75006]:       <source dev="/dev/sdc"/>
Nov 27 03:21:58 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:21:58 user nova-compute[75006]:       <serial>f0ba20c6-f7b4-4313-bd00-ebcf3293b469</serial>
Nov 27 03:21:58 user nova-compute[75006]:     </disk>
Nov 27 03:21:58 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:21:58 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:21:58 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.rescue"/>
Nov 27 03:21:58 user nova-compute[75006]:       <target dev="vdc" bus="virtio"/>
Nov 27 03:21:58 user nova-compute[75006]:       <boot order="1"/>
Nov 27 03:21:58 user nova-compute[75006]:     </disk>
Nov 27 03:21:58 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:21:58 user nova-compute[75006]:       <mac address="fa:16:3e:8f:6e:07"/>
Nov 27 03:21:58 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:21:58 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:21:58 user nova-compute[75006]:       <target dev="tapf94812d5-e0"/>
Nov 27 03:21:58 user nova-compute[75006]:     </interface>
Nov 27 03:21:58 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:21:58 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/console.log" append="off"/>
Nov 27 03:21:58 user nova-compute[75006]:     </serial>
Nov 27 03:21:58 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:21:58 user nova-compute[75006]:     <video>
Nov 27 03:21:58 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:21:58 user nova-compute[75006]:     </video>
Nov 27 03:21:58 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:21:58 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:21:58 user nova-compute[75006]:     </rng>
Nov 27 03:21:58 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:21:58 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:21:58 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:21:58 user nova-compute[75006]:     </memballoon>
Nov 27 03:21:58 user nova-compute[75006]:   </devices>
Nov 27 03:21:58 user nova-compute[75006]: </domain>
Nov 27 03:21:58 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:21:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance destroyed successfully.
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received event network-vif-unplugged-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] Acquiring lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] No waiting events found dispatching network-vif-unplugged-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received event network-vif-unplugged-1e445a88-b315-40e5-824c-f937bb4e4c97 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received event network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] Acquiring lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] No waiting events found dispatching network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:21:58 user nova-compute[75006]: WARNING nova.compute.manager [req-baec1283-3d4c-4ff2-97ea-abb274b18870 req-5b51ba1e-91c3-4ed0-be2e-0449cc91e06d service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received unexpected event network-vif-plugged-1e445a88-b315-40e5-824c-f937bb4e4c97 for instance with vm_state active and task_state deleting.
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] No VIF found with MAC fa:16:3e:8f:6e:07, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:21:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Instance destroyed successfully.
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'resources' on Instance uuid f6c29a59-34d3-4aa9-8c87-447f0b3a0f74 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-494812',display_name='tempest-AttachVolumeNegativeTest-server-494812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-494812',id=14,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6wqbCOAOtkuwMNPFkjVE137c247d52y7rO9KJcmKBzg/OVTUwwviYtHSw3+0X6RDwKS8JNQFQHfWSjf47/2dicamQDJTvKvQ+r9n2KiB+RnMw+kv0nHW+s/+rw6QtntA==',key_name='tempest-keypair-1965800954',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-ctxe98jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=f6c29a59-34d3-4aa9-8c87-447f0b3a0f74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "1e445a88-b315-40e5-824c-f937bb4e4c97", "address": "fa:16:3e:51:08:1b", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e445a88-b3", "ovs_interfaceid": "1e445a88-b315-40e5-824c-f937bb4e4c97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:08:1b,bridge_name='br-int',has_traffic_filtering=True,id=1e445a88-b315-40e5-824c-f937bb4e4c97,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e445a88-b3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG os_vif [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:08:1b,bridge_name='br-int',has_traffic_filtering=True,id=1e445a88-b315-40e5-824c-f937bb4e4c97,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e445a88-b3') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e445a88-b3, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b75d91e7-ffd9-47bf-a376-0079b662e1ef) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:58 user nova-compute[75006]: INFO os_vif [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:08:1b,bridge_name='br-int',has_traffic_filtering=True,id=1e445a88-b315-40e5-824c-f937bb4e4c97,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e445a88-b3')
Nov 27 03:21:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Deleting instance files /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74_del
Nov 27 03:21:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Deletion of /opt/stack/data/nova/instances/f6c29a59-34d3-4aa9-8c87-447f0b3a0f74_del complete
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.policy [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8df2fba5f3724b2fb210eef7331a2dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ce3c8acb7748f8af5dce8fc3f02ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:21:58 user nova-compute[75006]: INFO nova.compute.manager [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Took 2.22 seconds to destroy the instance on the hypervisor.
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:21:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Creating image(s)
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk 1073741824" returned: 0 in 0.064s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Successfully created port: 01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.213s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Cannot resize image /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Ensure instance console log exists: /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:21:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-ec65b510-7ba5-4c57-bb15-7ea6001b0b39 req-f7e64a1e-1d0b-45c9-902f-d7f2d4debfa0 service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Received event network-vif-deleted-1e445a88-b315-40e5-824c-f937bb4e4c97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:00 user nova-compute[75006]: INFO nova.compute.manager [req-ec65b510-7ba5-4c57-bb15-7ea6001b0b39 req-f7e64a1e-1d0b-45c9-902f-d7f2d4debfa0 service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Neutron deleted interface 1e445a88-b315-40e5-824c-f937bb4e4c97; detaching it from the instance and deleting it from the info cache
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.network.neutron [req-ec65b510-7ba5-4c57-bb15-7ea6001b0b39 req-f7e64a1e-1d0b-45c9-902f-d7f2d4debfa0 service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:00 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Took 1.22 seconds to deallocate network for instance.
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-ec65b510-7ba5-4c57-bb15-7ea6001b0b39 req-f7e64a1e-1d0b-45c9-902f-d7f2d4debfa0 service nova] [instance: f6c29a59-34d3-4aa9-8c87-447f0b3a0f74] Detach interface failed, port_id=1e445a88-b315-40e5-824c-f937bb4e4c97, reason: Instance f6c29a59-34d3-4aa9-8c87-447f0b3a0f74 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-829d0315-f787-41ec-911c-4221e9bb4ff3 req-a6846417-7d5f-4b5d-8674-2963bfb10e49 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-829d0315-f787-41ec-911c-4221e9bb4ff3 req-a6846417-7d5f-4b5d-8674-2963bfb10e49 service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-829d0315-f787-41ec-911c-4221e9bb4ff3 req-a6846417-7d5f-4b5d-8674-2963bfb10e49 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-829d0315-f787-41ec-911c-4221e9bb4ff3 req-a6846417-7d5f-4b5d-8674-2963bfb10e49 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-829d0315-f787-41ec-911c-4221e9bb4ff3 req-a6846417-7d5f-4b5d-8674-2963bfb10e49 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:00 user nova-compute[75006]: WARNING nova.compute.manager [req-829d0315-f787-41ec-911c-4221e9bb4ff3 req-a6846417-7d5f-4b5d-8674-2963bfb10e49 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state stopped and task_state powering-on.
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Successfully updated port: 01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquired lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-14d29a69-5c7c-4859-8182-8c66e53891e0 req-8cc34e83-652f-47b6-8bd6-2f8b2ca9112a service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-changed-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-14d29a69-5c7c-4859-8182-8c66e53891e0 req-8cc34e83-652f-47b6-8bd6-2f8b2ca9112a service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Refreshing instance network info cache due to event network-changed-01db2ae6-9b70-456e-aaa3-ecec258c0a00. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14d29a69-5c7c-4859-8182-8c66e53891e0 req-8cc34e83-652f-47b6-8bd6-2f8b2ca9112a service nova] Acquiring lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:22:00 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Deleted allocations for instance f6c29a59-34d3-4aa9-8c87-447f0b3a0f74
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e004b13-f1d8-4ea0-a434-6f4bdce8b350 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "f6c29a59-34d3-4aa9-8c87-447f0b3a0f74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.126s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Releasing lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance network_info: |[{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14d29a69-5c7c-4859-8182-8c66e53891e0 req-8cc34e83-652f-47b6-8bd6-2f8b2ca9112a service nova] Acquired lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.network.neutron [req-14d29a69-5c7c-4859-8182-8c66e53891e0 req-8cc34e83-652f-47b6-8bd6-2f8b2ca9112a service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Refreshing network info cache for port 01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Start _get_guest_xml network_info=[{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:22:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:22:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:22:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:21:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lazy-loading 'pci_devices' on Instance uuid e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:22:01 user nova-compute[75006]:   <uuid>e8860f63-c6ce-43ee-8c6e-6eea89d901d1</uuid>
Nov 27 03:22:01 user nova-compute[75006]:   <name>instance-00000011</name>
Nov 27 03:22:01 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:22:01 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:22:01 user nova-compute[75006]:   <metadata>
Nov 27 03:22:01 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:22:01 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:22:01 user nova-compute[75006]:       <nova:name>tempest-ServerActionsTestOtherB-server-908294320</nova:name>
Nov 27 03:22:01 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:22:00</nova:creationTime>
Nov 27 03:22:01 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:22:01 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:22:01 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:22:01 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:22:01 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:22:01 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:22:01 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:22:01 user nova-compute[75006]:       <nova:owner>
Nov 27 03:22:01 user nova-compute[75006]:         <nova:user uuid="8df2fba5f3724b2fb210eef7331a2dcd">tempest-ServerActionsTestOtherB-1115240976-project-member</nova:user>
Nov 27 03:22:01 user nova-compute[75006]:         <nova:project uuid="00ce3c8acb7748f8af5dce8fc3f02ebe">tempest-ServerActionsTestOtherB-1115240976</nova:project>
Nov 27 03:22:01 user nova-compute[75006]:       </nova:owner>
Nov 27 03:22:01 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:22:01 user nova-compute[75006]:       <nova:ports>
Nov 27 03:22:01 user nova-compute[75006]:         <nova:port uuid="01db2ae6-9b70-456e-aaa3-ecec258c0a00">
Nov 27 03:22:01 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 03:22:01 user nova-compute[75006]:         </nova:port>
Nov 27 03:22:01 user nova-compute[75006]:       </nova:ports>
Nov 27 03:22:01 user nova-compute[75006]:     </nova:instance>
Nov 27 03:22:01 user nova-compute[75006]:   </metadata>
Nov 27 03:22:01 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:22:01 user nova-compute[75006]:     <system>
Nov 27 03:22:01 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:22:01 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:22:01 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:22:01 user nova-compute[75006]:       <entry name="serial">e8860f63-c6ce-43ee-8c6e-6eea89d901d1</entry>
Nov 27 03:22:01 user nova-compute[75006]:       <entry name="uuid">e8860f63-c6ce-43ee-8c6e-6eea89d901d1</entry>
Nov 27 03:22:01 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:22:01 user nova-compute[75006]:     </system>
Nov 27 03:22:01 user nova-compute[75006]:   </sysinfo>
Nov 27 03:22:01 user nova-compute[75006]:   <os>
Nov 27 03:22:01 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:22:01 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:22:01 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:22:01 user nova-compute[75006]:   </os>
Nov 27 03:22:01 user nova-compute[75006]:   <features>
Nov 27 03:22:01 user nova-compute[75006]:     <acpi/>
Nov 27 03:22:01 user nova-compute[75006]:     <apic/>
Nov 27 03:22:01 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:22:01 user nova-compute[75006]:   </features>
Nov 27 03:22:01 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:22:01 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:22:01 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:22:01 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:22:01 user nova-compute[75006]:   </clock>
Nov 27 03:22:01 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:22:01 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:22:01 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:22:01 user nova-compute[75006]:   </cpu>
Nov 27 03:22:01 user nova-compute[75006]:   <devices>
Nov 27 03:22:01 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:22:01 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:22:01 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk"/>
Nov 27 03:22:01 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:22:01 user nova-compute[75006]:     </disk>
Nov 27 03:22:01 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:22:01 user nova-compute[75006]:       <mac address="fa:16:3e:d9:f7:5f"/>
Nov 27 03:22:01 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:22:01 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:22:01 user nova-compute[75006]:       <target dev="tap01db2ae6-9b"/>
Nov 27 03:22:01 user nova-compute[75006]:     </interface>
Nov 27 03:22:01 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:22:01 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/console.log" append="off"/>
Nov 27 03:22:01 user nova-compute[75006]:     </serial>
Nov 27 03:22:01 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:22:01 user nova-compute[75006]:     <video>
Nov 27 03:22:01 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:22:01 user nova-compute[75006]:     </video>
Nov 27 03:22:01 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:22:01 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:22:01 user nova-compute[75006]:     </rng>
Nov 27 03:22:01 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:22:01 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:22:01 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:22:01 user nova-compute[75006]:     </memballoon>
Nov 27 03:22:01 user nova-compute[75006]:   </devices>
Nov 27 03:22:01 user nova-compute[75006]: </domain>
Nov 27 03:22:01 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:21:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG os_vif [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f161893-a824-536b-aad9-9d3fcc9391d0', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01db2ae6-9b, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01db2ae6-9b, col_values=(('qos', UUID('f9d640a3-2383-447e-baa9-c97e304d2c59')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01db2ae6-9b, col_values=(('external_ids', {'iface-id': '01db2ae6-9b70-456e-aaa3-ecec258c0a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:f7:5f', 'vm-uuid': 'e8860f63-c6ce-43ee-8c6e-6eea89d901d1'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: INFO os_vif [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b')
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] No VIF found with MAC fa:16:3e:d9:f7:5f, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.network.neutron [req-14d29a69-5c7c-4859-8182-8c66e53891e0 req-8cc34e83-652f-47b6-8bd6-2f8b2ca9112a service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updated VIF entry in instance network info cache for port 01db2ae6-9b70-456e-aaa3-ecec258c0a00. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG nova.network.neutron [req-14d29a69-5c7c-4859-8182-8c66e53891e0 req-8cc34e83-652f-47b6-8bd6-2f8b2ca9112a service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14d29a69-5c7c-4859-8182-8c66e53891e0 req-8cc34e83-652f-47b6-8bd6-2f8b2ca9112a service nova] Releasing lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-a93e78ec-cee8-42e9-a0d3-36e147d21489 req-c7a0bcdd-84d8-47d3-bba1-a7fd15ef8467 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a93e78ec-cee8-42e9-a0d3-36e147d21489 req-c7a0bcdd-84d8-47d3-bba1-a7fd15ef8467 service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a93e78ec-cee8-42e9-a0d3-36e147d21489 req-c7a0bcdd-84d8-47d3-bba1-a7fd15ef8467 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a93e78ec-cee8-42e9-a0d3-36e147d21489 req-c7a0bcdd-84d8-47d3-bba1-a7fd15ef8467 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-a93e78ec-cee8-42e9-a0d3-36e147d21489 req-c7a0bcdd-84d8-47d3-bba1-a7fd15ef8467 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:02 user nova-compute[75006]: WARNING nova.compute.manager [req-a93e78ec-cee8-42e9-a0d3-36e147d21489 req-c7a0bcdd-84d8-47d3-bba1-a7fd15ef8467 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state stopped and task_state powering-on.
Nov 27 03:22:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:02 user nova-compute[75006]: WARNING nova.compute.manager [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state active and task_state rescuing.
Nov 27 03:22:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:02 user nova-compute[75006]: WARNING nova.compute.manager [req-366a640f-19d6-4a0c-aba6-4b6f36fb96e0 req-61ca85f6-3468-4cd7-bbbd-736231384ffe service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state active and task_state rescuing.
Nov 27 03:22:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-fbb6e694-0f16-448f-9faf-353582734287 req-19e19666-7d7f-42c0-9709-f5bfd9fe5d21 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fbb6e694-0f16-448f-9faf-353582734287 req-19e19666-7d7f-42c0-9709-f5bfd9fe5d21 service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fbb6e694-0f16-448f-9faf-353582734287 req-19e19666-7d7f-42c0-9709-f5bfd9fe5d21 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fbb6e694-0f16-448f-9faf-353582734287 req-19e19666-7d7f-42c0-9709-f5bfd9fe5d21 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-fbb6e694-0f16-448f-9faf-353582734287 req-19e19666-7d7f-42c0-9709-f5bfd9fe5d21 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:03 user nova-compute[75006]: WARNING nova.compute.manager [req-fbb6e694-0f16-448f-9faf-353582734287 req-19e19666-7d7f-42c0-9709-f5bfd9fe5d21 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state building and task_state spawning.
Nov 27 03:22:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:22:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance rebooted successfully.
Nov 27 03:22:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e496ed97-8efa-4500-9b92-f9f97e4b8d59 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:22:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-25d3b377-0a1a-4002-a4c7-c9f640944726 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-e472202a-1285-4f22-9a6c-2a52af1637ac req-a75f3baf-ec1c-474a-8508-cae5665cf815 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e472202a-1285-4f22-9a6c-2a52af1637ac req-a75f3baf-ec1c-474a-8508-cae5665cf815 service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e472202a-1285-4f22-9a6c-2a52af1637ac req-a75f3baf-ec1c-474a-8508-cae5665cf815 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e472202a-1285-4f22-9a6c-2a52af1637ac req-a75f3baf-ec1c-474a-8508-cae5665cf815 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-e472202a-1285-4f22-9a6c-2a52af1637ac req-a75f3baf-ec1c-474a-8508-cae5665cf815 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:05 user nova-compute[75006]: WARNING nova.compute.manager [req-e472202a-1285-4f22-9a6c-2a52af1637ac req-a75f3baf-ec1c-474a-8508-cae5665cf815 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state building and task_state spawning.
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:22:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance spawned successfully.
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:05 user nova-compute[75006]: INFO nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Took 6.51 seconds to spawn the instance on the hypervisor.
Nov 27 03:22:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:22:05 user nova-compute[75006]: INFO nova.compute.manager [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Took 7.62 seconds to build instance.
Nov 27 03:22:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c7775954-80ca-4c95-912f-64064f17cb01 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.807s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:22:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:22:07 user nova-compute[75006]: INFO nova.compute.claims [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Claim successful on node user
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:22:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.policy [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '797a8975406044ddabaad6e23950a71b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2d179ed36d41038da75b63b1bde170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "cb58f809-30cb-487b-b608-f2c7973d2225" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:22:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Creating image(s)
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:22:08 user nova-compute[75006]: INFO nova.compute.claims [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Claim successful on node user
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.226s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.299s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk 1073741824" returned: 0 in 0.058s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Successfully created port: 12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:22:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.policy [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '797a8975406044ddabaad6e23950a71b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2d179ed36d41038da75b63b1bde170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Cannot resize image /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Ensure instance console log exists: /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:22:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Creating image(s)
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.232s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.215s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Successfully updated port: 12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk 1073741824" returned: 0 in 0.059s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquired lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Successfully created port: 6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-87e4024c-dd29-4287-9306-7406b65a12e7 req-472de848-cd30-4fdb-85b4-c18ccd703d7e service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-changed-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-87e4024c-dd29-4287-9306-7406b65a12e7 req-472de848-cd30-4fdb-85b4-c18ccd703d7e service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Refreshing instance network info cache due to event network-changed-12ff1b53-230e-4e26-87d3-d3e6820f3bfd. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-87e4024c-dd29-4287-9306-7406b65a12e7 req-472de848-cd30-4fdb-85b4-c18ccd703d7e service nova] Acquiring lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.239s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updating instance_info_cache with network_info: [{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Cannot resize image /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Ensure instance console log exists: /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Releasing lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance network_info: |[{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-87e4024c-dd29-4287-9306-7406b65a12e7 req-472de848-cd30-4fdb-85b4-c18ccd703d7e service nova] Acquired lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-87e4024c-dd29-4287-9306-7406b65a12e7 req-472de848-cd30-4fdb-85b4-c18ccd703d7e service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Refreshing network info cache for port 12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Start _get_guest_xml network_info=[{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:22:10 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:22:10 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:22:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1753296171',display_name='tempest-ServerRescueNegativeTestJSON-server-1753296171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1753296171',id=18,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-05m618k5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:22:09Z,user_data=None,user_id='797a8975406044ddabaad6e23950a71b',uuid=831e3e26-daed-4b73-9470-0383e2cf6e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:88:83,bridge_name='br-int',has_traffic_filtering=True,id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ff1b53-23') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.objects.instance [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'pci_devices' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:22:11 user nova-compute[75006]:   <uuid>831e3e26-daed-4b73-9470-0383e2cf6e0f</uuid>
Nov 27 03:22:11 user nova-compute[75006]:   <name>instance-00000012</name>
Nov 27 03:22:11 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:22:11 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:22:11 user nova-compute[75006]:   <metadata>
Nov 27 03:22:11 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:22:11 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:22:11 user nova-compute[75006]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1753296171</nova:name>
Nov 27 03:22:11 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:22:10</nova:creationTime>
Nov 27 03:22:11 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:22:11 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:22:11 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:22:11 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:22:11 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:22:11 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:22:11 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:22:11 user nova-compute[75006]:       <nova:owner>
Nov 27 03:22:11 user nova-compute[75006]:         <nova:user uuid="797a8975406044ddabaad6e23950a71b">tempest-ServerRescueNegativeTestJSON-599355303-project-member</nova:user>
Nov 27 03:22:11 user nova-compute[75006]:         <nova:project uuid="7b2d179ed36d41038da75b63b1bde170">tempest-ServerRescueNegativeTestJSON-599355303</nova:project>
Nov 27 03:22:11 user nova-compute[75006]:       </nova:owner>
Nov 27 03:22:11 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:22:11 user nova-compute[75006]:       <nova:ports>
Nov 27 03:22:11 user nova-compute[75006]:         <nova:port uuid="12ff1b53-230e-4e26-87d3-d3e6820f3bfd">
Nov 27 03:22:11 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:22:11 user nova-compute[75006]:         </nova:port>
Nov 27 03:22:11 user nova-compute[75006]:       </nova:ports>
Nov 27 03:22:11 user nova-compute[75006]:     </nova:instance>
Nov 27 03:22:11 user nova-compute[75006]:   </metadata>
Nov 27 03:22:11 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:22:11 user nova-compute[75006]:     <system>
Nov 27 03:22:11 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:22:11 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:22:11 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:22:11 user nova-compute[75006]:       <entry name="serial">831e3e26-daed-4b73-9470-0383e2cf6e0f</entry>
Nov 27 03:22:11 user nova-compute[75006]:       <entry name="uuid">831e3e26-daed-4b73-9470-0383e2cf6e0f</entry>
Nov 27 03:22:11 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:22:11 user nova-compute[75006]:     </system>
Nov 27 03:22:11 user nova-compute[75006]:   </sysinfo>
Nov 27 03:22:11 user nova-compute[75006]:   <os>
Nov 27 03:22:11 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:22:11 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:22:11 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:22:11 user nova-compute[75006]:   </os>
Nov 27 03:22:11 user nova-compute[75006]:   <features>
Nov 27 03:22:11 user nova-compute[75006]:     <acpi/>
Nov 27 03:22:11 user nova-compute[75006]:     <apic/>
Nov 27 03:22:11 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:22:11 user nova-compute[75006]:   </features>
Nov 27 03:22:11 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:22:11 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:22:11 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:22:11 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:22:11 user nova-compute[75006]:   </clock>
Nov 27 03:22:11 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:22:11 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:22:11 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:22:11 user nova-compute[75006]:   </cpu>
Nov 27 03:22:11 user nova-compute[75006]:   <devices>
Nov 27 03:22:11 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:22:11 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:22:11 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk"/>
Nov 27 03:22:11 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:22:11 user nova-compute[75006]:     </disk>
Nov 27 03:22:11 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:22:11 user nova-compute[75006]:       <mac address="fa:16:3e:09:88:83"/>
Nov 27 03:22:11 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:22:11 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:22:11 user nova-compute[75006]:       <target dev="tap12ff1b53-23"/>
Nov 27 03:22:11 user nova-compute[75006]:     </interface>
Nov 27 03:22:11 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:22:11 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/console.log" append="off"/>
Nov 27 03:22:11 user nova-compute[75006]:     </serial>
Nov 27 03:22:11 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:22:11 user nova-compute[75006]:     <video>
Nov 27 03:22:11 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:22:11 user nova-compute[75006]:     </video>
Nov 27 03:22:11 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:22:11 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:22:11 user nova-compute[75006]:     </rng>
Nov 27 03:22:11 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:22:11 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:22:11 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:22:11 user nova-compute[75006]:     </memballoon>
Nov 27 03:22:11 user nova-compute[75006]:   </devices>
Nov 27 03:22:11 user nova-compute[75006]: </domain>
Nov 27 03:22:11 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1753296171',display_name='tempest-ServerRescueNegativeTestJSON-server-1753296171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1753296171',id=18,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-05m618k5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:22:09Z,user_data=None,user_id='797a8975406044ddabaad6e23950a71b',uuid=831e3e26-daed-4b73-9470-0383e2cf6e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:88:83,bridge_name='br-int',has_traffic_filtering=True,id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ff1b53-23') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG os_vif [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:88:83,bridge_name='br-int',has_traffic_filtering=True,id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ff1b53-23') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1acf15d0-41ef-546f-bdde-d54822225ccb', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12ff1b53-23, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12ff1b53-23, col_values=(('qos', UUID('0ad6cb94-cb2e-4ebf-a591-de17a8847661')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12ff1b53-23, col_values=(('external_ids', {'iface-id': '12ff1b53-230e-4e26-87d3-d3e6820f3bfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:88:83', 'vm-uuid': '831e3e26-daed-4b73-9470-0383e2cf6e0f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:11 user nova-compute[75006]: INFO os_vif [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:88:83,bridge_name='br-int',has_traffic_filtering=True,id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ff1b53-23')
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No VIF found with MAC fa:16:3e:09:88:83, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Successfully updated port: 6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquired lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.neutron [req-87e4024c-dd29-4287-9306-7406b65a12e7 req-472de848-cd30-4fdb-85b4-c18ccd703d7e service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updated VIF entry in instance network info cache for port 12ff1b53-230e-4e26-87d3-d3e6820f3bfd. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.neutron [req-87e4024c-dd29-4287-9306-7406b65a12e7 req-472de848-cd30-4fdb-85b4-c18ccd703d7e service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updating instance_info_cache with network_info: [{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-52d56433-92ea-4d5d-985b-e9f47825433a req-90fc4cb0-1728-4174-b3ce-bb226849e1af service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-changed-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-52d56433-92ea-4d5d-985b-e9f47825433a req-90fc4cb0-1728-4174-b3ce-bb226849e1af service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Refreshing instance network info cache due to event network-changed-6fa4288a-6cba-4a47-b71c-0f07522e84e8. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-52d56433-92ea-4d5d-985b-e9f47825433a req-90fc4cb0-1728-4174-b3ce-bb226849e1af service nova] Acquiring lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-87e4024c-dd29-4287-9306-7406b65a12e7 req-472de848-cd30-4fdb-85b4-c18ccd703d7e service nova] Releasing lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:22:11 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updating instance_info_cache with network_info: [{"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Releasing lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Instance network_info: |[{"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-52d56433-92ea-4d5d-985b-e9f47825433a req-90fc4cb0-1728-4174-b3ce-bb226849e1af service nova] Acquired lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-52d56433-92ea-4d5d-985b-e9f47825433a req-90fc4cb0-1728-4174-b3ce-bb226849e1af service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Refreshing network info cache for port 6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Start _get_guest_xml network_info=[{"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:22:12 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:22:12 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-25001566',display_name='tempest-ServerRescueNegativeTestJSON-server-25001566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-25001566',id=19,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-grd0zaz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:22:10Z,user_data=None,user_id='797a8975406044ddabaad6e23950a71b',uuid=cb58f809-30cb-487b-b608-f2c7973d2225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8a:a9,bridge_name='br-int',has_traffic_filtering=True,id=6fa4288a-6cba-4a47-b71c-0f07522e84e8,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa4288a-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.objects.instance [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'pci_devices' on Instance uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:22:12 user nova-compute[75006]:   <uuid>cb58f809-30cb-487b-b608-f2c7973d2225</uuid>
Nov 27 03:22:12 user nova-compute[75006]:   <name>instance-00000013</name>
Nov 27 03:22:12 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:22:12 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:22:12 user nova-compute[75006]:   <metadata>
Nov 27 03:22:12 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:22:12 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:22:12 user nova-compute[75006]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-25001566</nova:name>
Nov 27 03:22:12 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:22:12</nova:creationTime>
Nov 27 03:22:12 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:22:12 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:22:12 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:22:12 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:22:12 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:22:12 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:22:12 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:22:12 user nova-compute[75006]:       <nova:owner>
Nov 27 03:22:12 user nova-compute[75006]:         <nova:user uuid="797a8975406044ddabaad6e23950a71b">tempest-ServerRescueNegativeTestJSON-599355303-project-member</nova:user>
Nov 27 03:22:12 user nova-compute[75006]:         <nova:project uuid="7b2d179ed36d41038da75b63b1bde170">tempest-ServerRescueNegativeTestJSON-599355303</nova:project>
Nov 27 03:22:12 user nova-compute[75006]:       </nova:owner>
Nov 27 03:22:12 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:22:12 user nova-compute[75006]:       <nova:ports>
Nov 27 03:22:12 user nova-compute[75006]:         <nova:port uuid="6fa4288a-6cba-4a47-b71c-0f07522e84e8">
Nov 27 03:22:12 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 03:22:12 user nova-compute[75006]:         </nova:port>
Nov 27 03:22:12 user nova-compute[75006]:       </nova:ports>
Nov 27 03:22:12 user nova-compute[75006]:     </nova:instance>
Nov 27 03:22:12 user nova-compute[75006]:   </metadata>
Nov 27 03:22:12 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:22:12 user nova-compute[75006]:     <system>
Nov 27 03:22:12 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:22:12 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:22:12 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:22:12 user nova-compute[75006]:       <entry name="serial">cb58f809-30cb-487b-b608-f2c7973d2225</entry>
Nov 27 03:22:12 user nova-compute[75006]:       <entry name="uuid">cb58f809-30cb-487b-b608-f2c7973d2225</entry>
Nov 27 03:22:12 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:22:12 user nova-compute[75006]:     </system>
Nov 27 03:22:12 user nova-compute[75006]:   </sysinfo>
Nov 27 03:22:12 user nova-compute[75006]:   <os>
Nov 27 03:22:12 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:22:12 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:22:12 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:22:12 user nova-compute[75006]:   </os>
Nov 27 03:22:12 user nova-compute[75006]:   <features>
Nov 27 03:22:12 user nova-compute[75006]:     <acpi/>
Nov 27 03:22:12 user nova-compute[75006]:     <apic/>
Nov 27 03:22:12 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:22:12 user nova-compute[75006]:   </features>
Nov 27 03:22:12 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:22:12 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:22:12 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:22:12 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:22:12 user nova-compute[75006]:   </clock>
Nov 27 03:22:12 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:22:12 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:22:12 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:22:12 user nova-compute[75006]:   </cpu>
Nov 27 03:22:12 user nova-compute[75006]:   <devices>
Nov 27 03:22:12 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:22:12 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:22:12 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk"/>
Nov 27 03:22:12 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:22:12 user nova-compute[75006]:     </disk>
Nov 27 03:22:12 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:22:12 user nova-compute[75006]:       <mac address="fa:16:3e:0c:8a:a9"/>
Nov 27 03:22:12 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:22:12 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:22:12 user nova-compute[75006]:       <target dev="tap6fa4288a-6c"/>
Nov 27 03:22:12 user nova-compute[75006]:     </interface>
Nov 27 03:22:12 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:22:12 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/console.log" append="off"/>
Nov 27 03:22:12 user nova-compute[75006]:     </serial>
Nov 27 03:22:12 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:22:12 user nova-compute[75006]:     <video>
Nov 27 03:22:12 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:22:12 user nova-compute[75006]:     </video>
Nov 27 03:22:12 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:22:12 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:22:12 user nova-compute[75006]:     </rng>
Nov 27 03:22:12 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:22:12 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:22:12 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:22:12 user nova-compute[75006]:     </memballoon>
Nov 27 03:22:12 user nova-compute[75006]:   </devices>
Nov 27 03:22:12 user nova-compute[75006]: </domain>
Nov 27 03:22:12 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-25001566',display_name='tempest-ServerRescueNegativeTestJSON-server-25001566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-25001566',id=19,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-grd0zaz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:22:10Z,user_data=None,user_id='797a8975406044ddabaad6e23950a71b',uuid=cb58f809-30cb-487b-b608-f2c7973d2225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8a:a9,bridge_name='br-int',has_traffic_filtering=True,id=6fa4288a-6cba-4a47-b71c-0f07522e84e8,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa4288a-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG os_vif [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8a:a9,bridge_name='br-int',has_traffic_filtering=True,id=6fa4288a-6cba-4a47-b71c-0f07522e84e8,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa4288a-6c') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '467424a3-2f42-5aa8-9b7e-644888930299', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fa4288a-6c, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fa4288a-6c, col_values=(('qos', UUID('345b05de-3621-432f-9081-6ad83cfc9cfc')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fa4288a-6c, col_values=(('external_ids', {'iface-id': '6fa4288a-6cba-4a47-b71c-0f07522e84e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:8a:a9', 'vm-uuid': 'cb58f809-30cb-487b-b608-f2c7973d2225'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: INFO os_vif [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8a:a9,bridge_name='br-int',has_traffic_filtering=True,id=6fa4288a-6cba-4a47-b71c-0f07522e84e8,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa4288a-6c')
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No VIF found with MAC fa:16:3e:0c:8a:a9, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "503a960f-c3f6-4b8f-af89-7796916be32c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:12 user nova-compute[75006]: INFO nova.compute.manager [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Terminating instance
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-52d56433-92ea-4d5d-985b-e9f47825433a req-90fc4cb0-1728-4174-b3ce-bb226849e1af service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updated VIF entry in instance network info cache for port 6fa4288a-6cba-4a47-b71c-0f07522e84e8. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-52d56433-92ea-4d5d-985b-e9f47825433a req-90fc4cb0-1728-4174-b3ce-bb226849e1af service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updating instance_info_cache with network_info: [{"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-52d56433-92ea-4d5d-985b-e9f47825433a req-90fc4cb0-1728-4174-b3ce-bb226849e1af service nova] Releasing lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-a18ab5ee-5f3b-453a-8461-c180c5cfd001 req-dbe00285-bb2d-4f1b-93ed-43a37399632b service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a18ab5ee-5f3b-453a-8461-c180c5cfd001 req-dbe00285-bb2d-4f1b-93ed-43a37399632b service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a18ab5ee-5f3b-453a-8461-c180c5cfd001 req-dbe00285-bb2d-4f1b-93ed-43a37399632b service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a18ab5ee-5f3b-453a-8461-c180c5cfd001 req-dbe00285-bb2d-4f1b-93ed-43a37399632b service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-a18ab5ee-5f3b-453a-8461-c180c5cfd001 req-dbe00285-bb2d-4f1b-93ed-43a37399632b service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:13 user nova-compute[75006]: WARNING nova.compute.manager [req-a18ab5ee-5f3b-453a-8461-c180c5cfd001 req-dbe00285-bb2d-4f1b-93ed-43a37399632b service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state building and task_state spawning.
Nov 27 03:22:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-unplugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] No waiting events found dispatching network-vif-unplugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-unplugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] Acquiring lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] Lock "503a960f-c3f6-4b8f-af89-7796916be32c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] No waiting events found dispatching network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:13 user nova-compute[75006]: WARNING nova.compute.manager [req-69aa894a-4767-4165-9f63-d08802e7fa26 req-ddaebc37-d0ea-4e8f-8b62-b2f982a303c7 service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received unexpected event network-vif-plugged-1856fd0c-42fd-44e2-b937-2bf7564d7f13 for instance with vm_state active and task_state deleting.
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Instance destroyed successfully.
Nov 27 03:22:14 user nova-compute[75006]: DEBUG nova.objects.instance [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lazy-loading 'resources' on Instance uuid 503a960f-c3f6-4b8f-af89-7796916be32c {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215776583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1739552079',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEwjlY0CoUcygTkC5MyCYRqbOE6ERSsD3pzuc1AA/39Q08Ghvl6YSDYF0crP8xc6jrODLO9Q5HWNs2BEYtVvjp1IiwJwNqfALKa03qefDLZ2IO8YLyjexGBUJf2j1WyOg==',key_name='tempest-keypair-1820861676',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:20:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f859896de4a04f35a385b771412f684a',ramdisk_id='',reservation_id='r-7qq7bj0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-647617165',owner_user_name='tempest-ServerActionsV293TestJSON-647617165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='693d59e66f9e41478ce9a1d199f7633d',uuid=503a960f-c3f6-4b8f-af89-7796916be32c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converting VIF {"id": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "address": "fa:16:3e:2a:05:68", "network": {"id": "9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-744958026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f859896de4a04f35a385b771412f684a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1856fd0c-42", "ovs_interfaceid": "1856fd0c-42fd-44e2-b937-2bf7564d7f13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_vif [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1856fd0c-42, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c846d2af-e7f3-45c8-8337-55d8abbe8c66) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:14 user nova-compute[75006]: INFO os_vif [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:05:68,bridge_name='br-int',has_traffic_filtering=True,id=1856fd0c-42fd-44e2-b937-2bf7564d7f13,network=Network(9ab92a82-b16a-4b1f-8a3d-e2ec5d5cac25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1856fd0c-42')
Nov 27 03:22:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TURPKwXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:22:14 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ce12d1-0cfe-4904-91f7-8143b90d1b38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:22:14 user nova-compute[75006]: No targets found.
Nov 27 03:22:14 user nova-compute[75006]: iSNS:
Nov 27 03:22:14 user nova-compute[75006]: No targets found.
Nov 27 03:22:14 user nova-compute[75006]: STATIC:
Nov 27 03:22:14 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469
Nov 27 03:22:14 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:22:14 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:22:14 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d
Nov 27 03:22:14 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:22:14 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:22:14 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:22:14 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:22:14 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:22:14 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:22:14 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:22:14 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:22:14 user nova-compute[75006]: FIRMWARE:
Nov 27 03:22:14 user nova-compute[75006]: No targets found.
Nov 27 03:22:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:22:14 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:22:14 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8c520d-69f5-4e3a-a7e7-ebb3e8efa552]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a136a4d-c8da-4309-a9be-f8584b5e2f6a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:22:14 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:22:14 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:22:14 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:22:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d (non-flash)
Nov 27 03:22:14 user nova-compute[75006]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:22:14 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:22:14 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:22:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241724d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dae9d1-6ddf-466b-9a3a-0dfc7cb31925]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d432842-5069-47dc-a4cf-a3dc1192c665]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7fc4b5-9865-4a63-8c29-7519c81b4855]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0345aedb-a5ea-4c2e-a243-b1ae27e76a13]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4ed0fc-28d2-4e09-9444-764ab9e0c7e3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32d92c5-5e17-42d6-956a-04a7a8b9ae62]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260]
Nov 27 03:22:14 user nova-compute[75006]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d, portal: 172.16.0.220,3260] successful.
Nov 27 03:22:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13409c5f-0143-40b9-92f9-42dea666781d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7507b74-b7da-4f1f-bf29-ab0c550e63cb]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] <== disconnect_volume: return (342ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:22:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Deleting instance files /opt/stack/data/nova/instances/503a960f-c3f6-4b8f-af89-7796916be32c_del
Nov 27 03:22:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Deletion of /opt/stack/data/nova/instances/503a960f-c3f6-4b8f-af89-7796916be32c_del complete
Nov 27 03:22:14 user nova-compute[75006]: INFO nova.compute.manager [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Took 2.32 seconds to destroy the instance on the hypervisor.
Nov 27 03:22:14 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:22:14 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-38eeb722-8498-40fb-aac2-9285bc4d0edb req-1a87d97c-39bd-4a36-8e87-a2febb0e885e service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-38eeb722-8498-40fb-aac2-9285bc4d0edb req-1a87d97c-39bd-4a36-8e87-a2febb0e885e service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-38eeb722-8498-40fb-aac2-9285bc4d0edb req-1a87d97c-39bd-4a36-8e87-a2febb0e885e service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-38eeb722-8498-40fb-aac2-9285bc4d0edb req-1a87d97c-39bd-4a36-8e87-a2febb0e885e service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-38eeb722-8498-40fb-aac2-9285bc4d0edb req-1a87d97c-39bd-4a36-8e87-a2febb0e885e service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:15 user nova-compute[75006]: WARNING nova.compute.manager [req-38eeb722-8498-40fb-aac2-9285bc4d0edb req-1a87d97c-39bd-4a36-8e87-a2febb0e885e service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state building and task_state spawning.
Nov 27 03:22:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:16 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:16 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Took 1.28 seconds to deallocate network for instance.
Nov 27 03:22:17 user nova-compute[75006]: INFO nova.compute.manager [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Took 1.08 seconds to detach 1 volumes for instance.
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Deleting volume: 13409c5f-0143-40b9-92f9-42dea666781d {{(pid=75006) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance spawned successfully.
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] No waiting events found dispatching network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:17 user nova-compute[75006]: WARNING nova.compute.manager [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received unexpected event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 for instance with vm_state building and task_state spawning.
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] [instance: 503a960f-c3f6-4b8f-af89-7796916be32c] Received event network-vif-deleted-1856fd0c-42fd-44e2-b937-2bf7564d7f13 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] No waiting events found dispatching network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:22:17 user nova-compute[75006]: WARNING nova.compute.manager [req-72899ff2-ca57-4384-99dc-ec3c688830b5 req-f45c97a1-5c85-4268-a430-54d889501b1d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received unexpected event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 for instance with vm_state building and task_state spawning.
Nov 27 03:22:17 user nova-compute[75006]: INFO nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Took 8.62 seconds to spawn the instance on the hypervisor.
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:22:17 user nova-compute[75006]: INFO nova.compute.manager [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Took 9.62 seconds to build instance.
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-163c44c4-b3a6-4d2a-81bd-9409eb3b3fc2 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.729s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:22:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Instance spawned successfully.
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:22:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.645s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:17 user nova-compute[75006]: INFO nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Took 8.06 seconds to spawn the instance on the hypervisor.
Nov 27 03:22:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:22:18 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Deleted allocations for instance 503a960f-c3f6-4b8f-af89-7796916be32c
Nov 27 03:22:18 user nova-compute[75006]: INFO nova.compute.manager [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Took 9.17 seconds to build instance.
Nov 27 03:22:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ff72fd6c-6d83-4d1b-904b-22fbef1e9055 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "cb58f809-30cb-487b-b608-f2c7973d2225" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.348s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cd0ef444-1560-45c5-8210-a5007bbe4646 tempest-ServerActionsV293TestJSON-647617165 tempest-ServerActionsV293TestJSON-647617165-project-member] Lock "503a960f-c3f6-4b8f-af89-7796916be32c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.719s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:41 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:22:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:45 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:45 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:22:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:22:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:48 user nova-compute[75006]: INFO nova.compute.manager [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Detaching volume d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:48 user nova-compute[75006]: INFO nova.virt.block_device [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Attempting to driver detach volume d7ac48ee-8f75-4152-97fd-119cb30bb7eb from mountpoint /dev/vdb
Nov 27 03:22:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Attempting to detach device vdb from instance 5ee0634e-e918-4e98-a42c-496e3f7de095 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:22:48 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:22:48 user nova-compute[75006]:   <source dev="/dev/sdg"/>
Nov 27 03:22:48 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:22:48 user nova-compute[75006]:   <serial>d7ac48ee-8f75-4152-97fd-119cb30bb7eb</serial>
Nov 27 03:22:48 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:22:48 user nova-compute[75006]: </disk>
Nov 27 03:22:48 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully detached device vdb from instance 5ee0634e-e918-4e98-a42c-496e3f7de095 from the persistent domain config.
Nov 27 03:22:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ee0634e-e918-4e98-a42c-496e3f7de095 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:22:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:22:48 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:22:48 user nova-compute[75006]:   <source dev="/dev/sdg"/>
Nov 27 03:22:48 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:22:48 user nova-compute[75006]:   <serial>d7ac48ee-8f75-4152-97fd-119cb30bb7eb</serial>
Nov 27 03:22:48 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:22:48 user nova-compute[75006]: </disk>
Nov 27 03:22:48 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ee0634e-e918-4e98-a42c-496e3f7de095 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:22:50 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:22:50 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7261MB free_disk=25.388141632080078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fd992ae2-0b97-47d2-9e03-f707af65f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5ee0634e-e918-4e98-a42c-496e3f7de095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 7b4d808c-beca-4008-8733-31afc9b26d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e1b3e5d0-c175-42e0-bf86-79839548aadf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:22:50 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:22:51 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:22:51 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:22:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:22:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:22:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:52 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:22:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:22:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:22:52 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:22:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:22:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:22:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:22:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-bbac416b-ac32-42bc-9038-ed8b7b60b66d req-4eb08b89-5629-4737-a065-124167b999fe service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-changed-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-bbac416b-ac32-42bc-9038-ed8b7b60b66d req-4eb08b89-5629-4737-a065-124167b999fe service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Refreshing instance network info cache due to event network-changed-1ede6185-835b-45f8-a691-5d49116fdd90. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bbac416b-ac32-42bc-9038-ed8b7b60b66d req-4eb08b89-5629-4737-a065-124167b999fe service nova] Acquiring lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bbac416b-ac32-42bc-9038-ed8b7b60b66d req-4eb08b89-5629-4737-a065-124167b999fe service nova] Acquired lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-bbac416b-ac32-42bc-9038-ed8b7b60b66d req-4eb08b89-5629-4737-a065-124167b999fe service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Refreshing network info cache for port 1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "interface-7b4d808c-beca-4008-8733-31afc9b26d80-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "interface-7b4d808c-beca-4008-8733-31afc9b26d80-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lazy-loading 'flavor' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-bbac416b-ac32-42bc-9038-ed8b7b60b66d req-4eb08b89-5629-4737-a065-124167b999fe service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updated VIF entry in instance network info cache for port 1ede6185-835b-45f8-a691-5d49116fdd90. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-bbac416b-ac32-42bc-9038-ed8b7b60b66d req-4eb08b89-5629-4737-a065-124167b999fe service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating instance_info_cache with network_info: [{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lazy-loading 'pci_requests' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bbac416b-ac32-42bc-9038-ed8b7b60b66d req-4eb08b89-5629-4737-a065-124167b999fe service nova] Releasing lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.objects.base [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Object Instance<7b4d808c-beca-4008-8733-31afc9b26d80> lazy-loaded attributes: flavor,pci_requests {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:22:58 user nova-compute[75006]: DEBUG nova.policy [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fe95d495e394f6094f76fa8a9bdf8a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec104eb22944c46a2ed69b13fc26eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:22:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:22:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Successfully created port: 252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:23:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Successfully updated port: 252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:23:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquired lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:23:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-aba0b1be-145e-467b-8dd3-827f38441b37 req-00a841ca-c8d7-4a6f-a7a2-b576954a498b service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-changed-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-aba0b1be-145e-467b-8dd3-827f38441b37 req-00a841ca-c8d7-4a6f-a7a2-b576954a498b service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Refreshing instance network info cache due to event network-changed-252ba82d-08ad-4ebe-add5-55dc9e5c20c2. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:23:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aba0b1be-145e-467b-8dd3-827f38441b37 req-00a841ca-c8d7-4a6f-a7a2-b576954a498b service nova] Acquiring lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.network.neutron [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating instance_info_cache with network_info: [{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Releasing lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aba0b1be-145e-467b-8dd3-827f38441b37 req-00a841ca-c8d7-4a6f-a7a2-b576954a498b service nova] Acquired lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.network.neutron [req-aba0b1be-145e-467b-8dd3-827f38441b37 req-00a841ca-c8d7-4a6f-a7a2-b576954a498b service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Refreshing network info cache for port 252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converting VIF {"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG os_vif [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89eddeeb-8c12-5648-bbc2-0995c841ad98', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap252ba82d-08, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap252ba82d-08, col_values=(('qos', UUID('78ca4887-b107-4173-ac6e-ce19035ca84e')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap252ba82d-08, col_values=(('external_ids', {'iface-id': '252ba82d-08ad-4ebe-add5-55dc9e5c20c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:20:08', 'vm-uuid': '7b4d808c-beca-4008-8733-31afc9b26d80'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: INFO os_vif [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08')
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converting VIF {"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] attach device xml: <interface type="ethernet">
Nov 27 03:23:01 user nova-compute[75006]:   <mac address="fa:16:3e:f1:20:08"/>
Nov 27 03:23:01 user nova-compute[75006]:   <model type="virtio"/>
Nov 27 03:23:01 user nova-compute[75006]:   <mtu size="1442"/>
Nov 27 03:23:01 user nova-compute[75006]:   <target dev="tap252ba82d-08"/>
Nov 27 03:23:01 user nova-compute[75006]: </interface>
Nov 27 03:23:01 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No BDM found with device name hda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:23:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No VIF found with MAC fa:16:3e:72:63:dd, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:23:02 user nova-compute[75006]:   <nova:package version="0.0.0"/>
Nov 27 03:23:02 user nova-compute[75006]:   <nova:name>tempest-device-tagging-server-1358855801</nova:name>
Nov 27 03:23:02 user nova-compute[75006]:   <nova:creationTime>2023-11-27 03:23:02</nova:creationTime>
Nov 27 03:23:02 user nova-compute[75006]:   <nova:flavor name="m1.tiny">
Nov 27 03:23:02 user nova-compute[75006]:     <nova:memory>512</nova:memory>
Nov 27 03:23:02 user nova-compute[75006]:     <nova:disk>1</nova:disk>
Nov 27 03:23:02 user nova-compute[75006]:     <nova:swap>0</nova:swap>
Nov 27 03:23:02 user nova-compute[75006]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:23:02 user nova-compute[75006]:     <nova:vcpus>1</nova:vcpus>
Nov 27 03:23:02 user nova-compute[75006]:   </nova:flavor>
Nov 27 03:23:02 user nova-compute[75006]:   <nova:owner>
Nov 27 03:23:02 user nova-compute[75006]:     <nova:user uuid="8fe95d495e394f6094f76fa8a9bdf8a0">tempest-TaggedAttachmentsTest-2115441077-project-member</nova:user>
Nov 27 03:23:02 user nova-compute[75006]:     <nova:project uuid="cec104eb22944c46a2ed69b13fc26eec">tempest-TaggedAttachmentsTest-2115441077</nova:project>
Nov 27 03:23:02 user nova-compute[75006]:   </nova:owner>
Nov 27 03:23:02 user nova-compute[75006]:   <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:23:02 user nova-compute[75006]:   <nova:ports>
Nov 27 03:23:02 user nova-compute[75006]:     <nova:port uuid="1ede6185-835b-45f8-a691-5d49116fdd90">
Nov 27 03:23:02 user nova-compute[75006]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:23:02 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:02 user nova-compute[75006]:     <nova:port uuid="252ba82d-08ad-4ebe-add5-55dc9e5c20c2">
Nov 27 03:23:02 user nova-compute[75006]:       <nova:ip type="fixed" address="10.10.10.184" ipVersion="4"/>
Nov 27 03:23:02 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:02 user nova-compute[75006]:   </nova:ports>
Nov 27 03:23:02 user nova-compute[75006]: </nova:instance>
Nov 27 03:23:02 user nova-compute[75006]:  {{(pid=75006) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dfb8c451-0d8c-42ba-8fc9-e9c956bc59ef tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "interface-7b4d808c-beca-4008-8733-31afc9b26d80-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.452s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG nova.network.neutron [req-aba0b1be-145e-467b-8dd3-827f38441b37 req-00a841ca-c8d7-4a6f-a7a2-b576954a498b service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updated VIF entry in instance network info cache for port 252ba82d-08ad-4ebe-add5-55dc9e5c20c2. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG nova.network.neutron [req-aba0b1be-145e-467b-8dd3-827f38441b37 req-00a841ca-c8d7-4a6f-a7a2-b576954a498b service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating instance_info_cache with network_info: [{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aba0b1be-145e-467b-8dd3-827f38441b37 req-00a841ca-c8d7-4a6f-a7a2-b576954a498b service nova] Releasing lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] No waiting events found dispatching network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:02 user nova-compute[75006]: WARNING nova.compute.manager [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received unexpected event network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 for instance with vm_state active and task_state None.
Nov 27 03:23:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] No waiting events found dispatching network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:02 user nova-compute[75006]: WARNING nova.compute.manager [req-1d90dbc5-550b-4e40-bfe2-1e5b116f2da6 req-7e1bbbde-6cd1-435f-b3f8-79533290c2a2 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received unexpected event network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 for instance with vm_state active and task_state None.
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG nova.objects.instance [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lazy-loading 'flavor' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:03 user nova-compute[75006]: INFO nova.compute.manager [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Attaching volume 9cc7e290-18e5-40d4-ae13-5c53d7486cea to /dev/vdb
Nov 27 03:23:03 user nova-compute[75006]: DEBUG os_brick.utils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e2f8ef-2504-4a82-950d-3e61853bac82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc648859-4981-4cfc-9651-992cad03574c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03ab34a-5076-453c-86b9-1eaa12d52455]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a9d799-67a6-4a2f-a93e-d956783a1ed3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:23:03 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:23:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[797cb287-76c8-4ade-9a17-4110511f5702]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG os_brick.utils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:23:03 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating existing volume attachment record: 0991da86-8ad9-408d-bc49-5940b4e3af99 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "e1b3e5d0-c175-42e0-bf86-79839548aadf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:04 user nova-compute[75006]: INFO nova.compute.manager [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Terminating instance
Nov 27 03:23:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-793b3adb-b26a-4567-982b-29adc120e580 req-18f853a8-9155-4165-8c5a-f862f898a5e6 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received event network-vif-unplugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-793b3adb-b26a-4567-982b-29adc120e580 req-18f853a8-9155-4165-8c5a-f862f898a5e6 service nova] Acquiring lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-793b3adb-b26a-4567-982b-29adc120e580 req-18f853a8-9155-4165-8c5a-f862f898a5e6 service nova] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-793b3adb-b26a-4567-982b-29adc120e580 req-18f853a8-9155-4165-8c5a-f862f898a5e6 service nova] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-793b3adb-b26a-4567-982b-29adc120e580 req-18f853a8-9155-4165-8c5a-f862f898a5e6 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] No waiting events found dispatching network-vif-unplugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-793b3adb-b26a-4567-982b-29adc120e580 req-18f853a8-9155-4165-8c5a-f862f898a5e6 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received event network-vif-unplugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Instance destroyed successfully.
Nov 27 03:23:05 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lazy-loading 'resources' on Instance uuid e1b3e5d0-c175-42e0-bf86-79839548aadf {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-943311580',display_name='tempest-VolumesAdminNegativeTest-server-943311580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-943311580',id=16,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a358e4342c8a48ddb127bdaf5a9256a8',ramdisk_id='',reservation_id='r-aty59r1o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1662628799',owner_user_name='tempest-VolumesAdminNegativeTest-1662628799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:21:15Z,user_data=None,user_id='4f150fc08fad489aa036b747757792f1',uuid=e1b3e5d0-c175-42e0-bf86-79839548aadf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converting VIF {"id": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "address": "fa:16:3e:d6:3f:22", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2cb34-2c", "ovs_interfaceid": "8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:22,bridge_name='br-int',has_traffic_filtering=True,id=8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2cb34-2c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG os_vif [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:22,bridge_name='br-int',has_traffic_filtering=True,id=8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2cb34-2c') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea2cb34-2c, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54a9bb62-59b9-4eea-9679-793c0c30ac05) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:05 user nova-compute[75006]: INFO os_vif [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:3f:22,bridge_name='br-int',has_traffic_filtering=True,id=8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2cb34-2c')
Nov 27 03:23:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Deleting instance files /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf_del
Nov 27 03:23:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Deletion of /opt/stack/data/nova/instances/e1b3e5d0-c175-42e0-bf86-79839548aadf_del complete
Nov 27 03:23:05 user nova-compute[75006]: INFO nova.compute.manager [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 27 03:23:05 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:23:05 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:06 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Took 0.94 seconds to deallocate network for instance.
Nov 27 03:23:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c3bc490-0686-480b-b801-31d5fff5de4b req-885bfb2b-7287-4fda-8e80-ec3de983e963 service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received event network-vif-deleted-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:06 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Deleted allocations for instance e1b3e5d0-c175-42e0-bf86-79839548aadf
Nov 27 03:23:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7a7c77dc-7282-41e1-a2c2-7a0c9d41878b tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-1b440684-a707-4f32-8f26-af5dd8478a3a req-ef3d0b7d-d440-4b18-9fad-9ce4bcff512e service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received event network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1b440684-a707-4f32-8f26-af5dd8478a3a req-ef3d0b7d-d440-4b18-9fad-9ce4bcff512e service nova] Acquiring lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1b440684-a707-4f32-8f26-af5dd8478a3a req-ef3d0b7d-d440-4b18-9fad-9ce4bcff512e service nova] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1b440684-a707-4f32-8f26-af5dd8478a3a req-ef3d0b7d-d440-4b18-9fad-9ce4bcff512e service nova] Lock "e1b3e5d0-c175-42e0-bf86-79839548aadf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-1b440684-a707-4f32-8f26-af5dd8478a3a req-ef3d0b7d-d440-4b18-9fad-9ce4bcff512e service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] No waiting events found dispatching network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:06 user nova-compute[75006]: WARNING nova.compute.manager [req-1b440684-a707-4f32-8f26-af5dd8478a3a req-ef3d0b7d-d440-4b18-9fad-9ce4bcff512e service nova] [instance: e1b3e5d0-c175-42e0-bf86-79839548aadf] Received unexpected event network-vif-plugged-8ea2cb34-2c84-4e97-bcb3-b6eb44d9dba6 for instance with vm_state deleted and task_state None.
Nov 27 03:23:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5ee0634e-e918-4e98-a42c-496e3f7de095 is timed out.
Nov 27 03:23:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully detached device vdb from instance 5ee0634e-e918-4e98-a42c-496e3f7de095 from the live domain config.
Nov 27 03:23:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BfWIYges', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:23:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[92599f00-ef6d-4c50-8793-543c8b92fafe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:23:09 user nova-compute[75006]: No targets found.
Nov 27 03:23:09 user nova-compute[75006]: iSNS:
Nov 27 03:23:09 user nova-compute[75006]: No targets found.
Nov 27 03:23:09 user nova-compute[75006]: STATIC:
Nov 27 03:23:09 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469
Nov 27 03:23:09 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:23:09 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:23:09 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:23:09 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:23:09 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:23:09 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb
Nov 27 03:23:09 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:23:09 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:23:09 user nova-compute[75006]: FIRMWARE:
Nov 27 03:23:09 user nova-compute[75006]: No targets found.
Nov 27 03:23:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:23:09 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:23:09 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b6ca5-9f29-44fe-aae4-d1554ea54407]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603c0a2-289c-450e-8569-9fb57d8e8a72]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:23:09 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:23:09 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:23:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:23:09 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:23:09 user nova-compute[75006]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb (non-flash)
Nov 27 03:23:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c243640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb'): ({'sdg'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Removing single pathed devices sdg {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[984066cd-b0f0-40c4-9446-247072502ad4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1c377-cdb1-4c83-8ff8-51d02bbff266]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flushing IO for device /dev/sdg {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1495202f-38a9-4194-989c-c2c8b1835352]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b7a2c0-2c00-459e-bd30-2dfc73e6f01e]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] SCSI volumes sdg have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3f94d2-3e6d-44c4-80cf-7ec379a5ba87]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[88978afd-2261-4711-ac30-a01238de91f1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb, portal: 172.16.0.220,3260]
Nov 27 03:23:09 user nova-compute[75006]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb, portal: 172.16.0.220,3260] successful.
Nov 27 03:23:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7ac48ee-8f75-4152-97fd-119cb30bb7eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[62da473c-b4b9-4585-b783-ab53e93e5227]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== disconnect_volume: return (330ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:23:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRvEtixg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:23:10 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:23:10 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:23:10 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[32132ba1-2fac-4139-abda-fe47822cadab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:23:10 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddbc833-1d4c-4ee2-b2eb-3eff3659d391]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea] added
Nov 27 03:23:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b374d1-e39b-45f7-9dfd-9c36c2b27b4e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f206f6b-e046-46dc-9f2d-72ed8b8b6df8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRvEtixg {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRvEtixg" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c34dd15-0856-4e29-b101-4b77ee35f499]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CRvEtixg'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adcfb29-ba30-4871-8733-7c4d269fcbe5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86d8530-2ce3-44dd-a28a-ad18e1c8fb32]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:23:10 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:23:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:23:10 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:23:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efbbd02-b9d8-42aa-ac7f-2762252dc6dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea, portal: 172.16.0.220,3260]
Nov 27 03:23:10 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea, portal: 172.16.0.220,3260] successful.
Nov 27 03:23:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf4e22-e392-46d4-a89e-3f06f392a876]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae7e2e-09e1-4f26-8e43-c49939feacf3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:23:10 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:23:10 user nova-compute[75006]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea (non-flash)
Nov 27 03:23:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:23:10 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:23:10 user nova-compute[75006]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea (non-flash)
Nov 27 03:23:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b6fc7d-123f-480d-8b59-a80fe954faeb]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRvEtixg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid 5ee0634e-e918-4e98-a42c-496e3f7de095 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-681b3188-48c4-47a6-b361-6dc030939bb5 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.074s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26534653037343032', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534653037343032', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG nova.objects.instance [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lazy-loading 'flavor' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:23:11 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:23:11 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:23:11 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:23:11 user nova-compute[75006]:   <serial>9cc7e290-18e5-40d4-ae13-5c53d7486cea</serial>
Nov 27 03:23:11 user nova-compute[75006]: </disk>
Nov 27 03:23:11 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No BDM found with device name hda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] No VIF found with MAC fa:16:3e:72:63:dd, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:23:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78573bec-bf23-421f-89c8-538f5df5b6c5 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.955s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:13 user nova-compute[75006]: INFO nova.compute.manager [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Detaching volume 9cc7e290-18e5-40d4-ae13-5c53d7486cea
Nov 27 03:23:13 user nova-compute[75006]: INFO nova.virt.block_device [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Attempting to driver detach volume 9cc7e290-18e5-40d4-ae13-5c53d7486cea from mountpoint /dev/vdb
Nov 27 03:23:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Attempting to detach device vdb from instance 7b4d808c-beca-4008-8733-31afc9b26d80 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:23:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:23:13 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:23:13 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:23:13 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:23:13 user nova-compute[75006]:   <serial>9cc7e290-18e5-40d4-ae13-5c53d7486cea</serial>
Nov 27 03:23:13 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 03:23:13 user nova-compute[75006]: </disk>
Nov 27 03:23:13 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:23:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Successfully detached device vdb from instance 7b4d808c-beca-4008-8733-31afc9b26d80 from the persistent domain config.
Nov 27 03:23:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b4d808c-beca-4008-8733-31afc9b26d80 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:23:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:23:13 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:23:13 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:23:13 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:23:13 user nova-compute[75006]:   <serial>9cc7e290-18e5-40d4-ae13-5c53d7486cea</serial>
Nov 27 03:23:13 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 03:23:13 user nova-compute[75006]: </disk>
Nov 27 03:23:13 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:23:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:23:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:33 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b4d808c-beca-4008-8733-31afc9b26d80 is timed out.
Nov 27 03:23:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Successfully detached device vdb from instance 7b4d808c-beca-4008-8733-31afc9b26d80 from the live domain config.
Nov 27 03:23:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:23:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRvEtixg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:23:33 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:23:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:23:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:23:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f6dba8-4f38-4631-8faa-73aeaaf86b75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:23:34 user nova-compute[75006]: No targets found.
Nov 27 03:23:34 user nova-compute[75006]: iSNS:
Nov 27 03:23:34 user nova-compute[75006]: No targets found.
Nov 27 03:23:34 user nova-compute[75006]: STATIC:
Nov 27 03:23:34 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469
Nov 27 03:23:34 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:23:34 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:23:34 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:23:34 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:23:34 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:23:34 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea
Nov 27 03:23:34 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:23:34 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:23:34 user nova-compute[75006]: FIRMWARE:
Nov 27 03:23:34 user nova-compute[75006]: No targets found.
Nov 27 03:23:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:23:34 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:23:34 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[25523463-e5cc-4835-9901-12ff95cad222]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a06e6a-2199-43c9-a01f-e6550a423844]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:23:34 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:23:34 user nova-compute[75006]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea (non-flash)
Nov 27 03:23:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:23:34 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:23:34 user nova-compute[75006]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea (non-flash)
Nov 27 03:23:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4007672e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0eb0b6-2cb4-464b-ad78-fba9dc306e90]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fdc480-3ba9-4460-97a2-919fd25120de]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaa58f6-8730-4419-8deb-6bed50ed4a69]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6629a10f-e9e3-4936-8f03-f0e53d1ffcd8]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.083s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbda609-cbfa-4a0a-8707-d01dfa51e6b4]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:23:34 user nova-compute[75006]: INFO nova.compute.claims [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Claim successful on node user
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d501d993-1c15-4c4b-92a3-90a2800a1aa6]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea, portal: 172.16.0.220,3260]
Nov 27 03:23:34 user nova-compute[75006]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea, portal: 172.16.0.220,3260] successful.
Nov 27 03:23:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cc7e290-18e5-40d4-ae13-5c53d7486cea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d22e823-0778-4880-8046-21e3efc843d8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] <== disconnect_volume: return (393ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:23:34 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.policy [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b516ef03ccc4fd1be4195d9b4cd35b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ecd6ee9712450f9baaecf096a510ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:23:34 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Creating image(s)
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "/opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "/opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "/opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.229s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lazy-loading 'flavor' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6bd88115-7c53-4052-8788-73a8722be10d tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.861s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk 1073741824" returned: 0 in 0.051s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Successfully created port: 1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.201s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Cannot resize image /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Ensure instance console log exists: /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Successfully updated port: 1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquired lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-2e2d59f6-1f36-4f37-a7d4-58c6e2982372 req-3a858868-ad35-4ed4-a9d4-326880854c5e service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Received event network-changed-1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-2e2d59f6-1f36-4f37-a7d4-58c6e2982372 req-3a858868-ad35-4ed4-a9d4-326880854c5e service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Refreshing instance network info cache due to event network-changed-1a39f5fd-b558-47c4-bda3-3248d68aa175. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2e2d59f6-1f36-4f37-a7d4-58c6e2982372 req-3a858868-ad35-4ed4-a9d4-326880854c5e service nova] Acquiring lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "interface-7b4d808c-beca-4008-8733-31afc9b26d80-252ba82d-08ad-4ebe-add5-55dc9e5c20c2" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "interface-7b4d808c-beca-4008-8733-31afc9b26d80-252ba82d-08ad-4ebe-add5-55dc9e5c20c2" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.objects.instance [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lazy-loading 'flavor' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converting VIF {"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface> {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface> {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Attempting to detach device tap252ba82d-08 from instance 7b4d808c-beca-4008-8733-31afc9b26d80 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] detach device xml: <interface type="ethernet">
Nov 27 03:23:36 user nova-compute[75006]:   <mac address="fa:16:3e:f1:20:08"/>
Nov 27 03:23:36 user nova-compute[75006]:   <model type="virtio"/>
Nov 27 03:23:36 user nova-compute[75006]:   <mtu size="1442"/>
Nov 27 03:23:36 user nova-compute[75006]:   <target dev="tap252ba82d-08"/>
Nov 27 03:23:36 user nova-compute[75006]: </interface>
Nov 27 03:23:36 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface> {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 27 03:23:36 user nova-compute[75006]:   <name>instance-0000000f</name>
Nov 27 03:23:36 user nova-compute[75006]:   <uuid>7b4d808c-beca-4008-8733-31afc9b26d80</uuid>
Nov 27 03:23:36 user nova-compute[75006]:   <metadata>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:23:36 user nova-compute[75006]:   <nova:package version="0.0.0"/>
Nov 27 03:23:36 user nova-compute[75006]:   <nova:name>tempest-device-tagging-server-1358855801</nova:name>
Nov 27 03:23:36 user nova-compute[75006]:   <nova:creationTime>2023-11-27 03:23:02</nova:creationTime>
Nov 27 03:23:36 user nova-compute[75006]:   <nova:flavor name="m1.tiny">
Nov 27 03:23:36 user nova-compute[75006]:     <nova:memory>512</nova:memory>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:disk>1</nova:disk>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:swap>0</nova:swap>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:vcpus>1</nova:vcpus>
Nov 27 03:23:36 user nova-compute[75006]:   </nova:flavor>
Nov 27 03:23:36 user nova-compute[75006]:   <nova:owner>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:user uuid="8fe95d495e394f6094f76fa8a9bdf8a0">tempest-TaggedAttachmentsTest-2115441077-project-member</nova:user>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:project uuid="cec104eb22944c46a2ed69b13fc26eec">tempest-TaggedAttachmentsTest-2115441077</nova:project>
Nov 27 03:23:36 user nova-compute[75006]:   </nova:owner>
Nov 27 03:23:36 user nova-compute[75006]:   <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:23:36 user nova-compute[75006]:   <nova:ports>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:port uuid="1ede6185-835b-45f8-a691-5d49116fdd90">
Nov 27 03:23:36 user nova-compute[75006]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:23:36 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:port uuid="252ba82d-08ad-4ebe-add5-55dc9e5c20c2">
Nov 27 03:23:36 user nova-compute[75006]:       <nova:ip type="fixed" address="10.10.10.184" ipVersion="4"/>
Nov 27 03:23:36 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:36 user nova-compute[75006]:   </nova:ports>
Nov 27 03:23:36 user nova-compute[75006]: </nova:instance>
Nov 27 03:23:36 user nova-compute[75006]:   </metadata>
Nov 27 03:23:36 user nova-compute[75006]:   <memory unit='KiB'>524288</memory>
Nov 27 03:23:36 user nova-compute[75006]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 03:23:36 user nova-compute[75006]:   <vcpu placement='static'>1</vcpu>
Nov 27 03:23:36 user nova-compute[75006]:   <resource>
Nov 27 03:23:36 user nova-compute[75006]:     <partition>/machine</partition>
Nov 27 03:23:36 user nova-compute[75006]:   </resource>
Nov 27 03:23:36 user nova-compute[75006]:   <sysinfo type='smbios'>
Nov 27 03:23:36 user nova-compute[75006]:     <system>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name='version'>0.0.0</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name='serial'>7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name='uuid'>7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name='family'>Virtual Machine</entry>
Nov 27 03:23:36 user nova-compute[75006]:     </system>
Nov 27 03:23:36 user nova-compute[75006]:   </sysinfo>
Nov 27 03:23:36 user nova-compute[75006]:   <os>
Nov 27 03:23:36 user nova-compute[75006]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 03:23:36 user nova-compute[75006]:     <boot dev='hd'/>
Nov 27 03:23:36 user nova-compute[75006]:     <smbios mode='sysinfo'/>
Nov 27 03:23:36 user nova-compute[75006]:   </os>
Nov 27 03:23:36 user nova-compute[75006]:   <features>
Nov 27 03:23:36 user nova-compute[75006]:     <acpi/>
Nov 27 03:23:36 user nova-compute[75006]:     <apic/>
Nov 27 03:23:36 user nova-compute[75006]:     <vmcoreinfo state='on'/>
Nov 27 03:23:36 user nova-compute[75006]:   </features>
Nov 27 03:23:36 user nova-compute[75006]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 03:23:36 user nova-compute[75006]:     <model fallback='forbid'>Nehalem</model>
Nov 27 03:23:36 user nova-compute[75006]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 03:23:36 user nova-compute[75006]:     <feature policy='require' name='vme'/>
Nov 27 03:23:36 user nova-compute[75006]:     <feature policy='require' name='x2apic'/>
Nov 27 03:23:36 user nova-compute[75006]:     <feature policy='require' name='hypervisor'/>
Nov 27 03:23:36 user nova-compute[75006]:   </cpu>
Nov 27 03:23:36 user nova-compute[75006]:   <clock offset='utc'>
Nov 27 03:23:36 user nova-compute[75006]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 03:23:36 user nova-compute[75006]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 03:23:36 user nova-compute[75006]:     <timer name='hpet' present='no'/>
Nov 27 03:23:36 user nova-compute[75006]:   </clock>
Nov 27 03:23:36 user nova-compute[75006]:   <on_poweroff>destroy</on_poweroff>
Nov 27 03:23:36 user nova-compute[75006]:   <on_reboot>restart</on_reboot>
Nov 27 03:23:36 user nova-compute[75006]:   <on_crash>destroy</on_crash>
Nov 27 03:23:36 user nova-compute[75006]:   <devices>
Nov 27 03:23:36 user nova-compute[75006]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 03:23:36 user nova-compute[75006]:     <disk type='file' device='disk'>
Nov 27 03:23:36 user nova-compute[75006]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 03:23:36 user nova-compute[75006]:       <source file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk' index='2'/>
Nov 27 03:23:36 user nova-compute[75006]:       <backingStore type='file' index='3'>
Nov 27 03:23:36 user nova-compute[75006]:         <format type='raw'/>
Nov 27 03:23:36 user nova-compute[75006]:         <source file='/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe'/>
Nov 27 03:23:36 user nova-compute[75006]:         <backingStore/>
Nov 27 03:23:36 user nova-compute[75006]:       </backingStore>
Nov 27 03:23:36 user nova-compute[75006]:       <target dev='vda' bus='virtio'/>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='virtio-disk0'/>
Nov 27 03:23:36 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </disk>
Nov 27 03:23:36 user nova-compute[75006]:     <disk type='file' device='cdrom'>
Nov 27 03:23:36 user nova-compute[75006]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 03:23:36 user nova-compute[75006]:       <source file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.config' index='1'/>
Nov 27 03:23:36 user nova-compute[75006]:       <backingStore/>
Nov 27 03:23:36 user nova-compute[75006]:       <target dev='hda' bus='ide'/>
Nov 27 03:23:36 user nova-compute[75006]:       <readonly/>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='ide0-0-0'/>
Nov 27 03:23:36 user nova-compute[75006]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </disk>
Nov 27 03:23:36 user nova-compute[75006]:     <controller type='usb' index='0' model='none'>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='usb'/>
Nov 27 03:23:36 user nova-compute[75006]:     </controller>
Nov 27 03:23:36 user nova-compute[75006]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='pci.0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </controller>
Nov 27 03:23:36 user nova-compute[75006]:     <controller type='ide' index='0'>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='ide'/>
Nov 27 03:23:36 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 03:23:36 user nova-compute[75006]:     </controller>
Nov 27 03:23:36 user nova-compute[75006]:     <interface type='ethernet'>
Nov 27 03:23:36 user nova-compute[75006]:       <mac address='fa:16:3e:72:63:dd'/>
Nov 27 03:23:36 user nova-compute[75006]:       <target dev='tap1ede6185-83'/>
Nov 27 03:23:36 user nova-compute[75006]:       <model type='virtio'/>
Nov 27 03:23:36 user nova-compute[75006]:       <mtu size='1442'/>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='net0'/>
Nov 27 03:23:36 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </interface>
Nov 27 03:23:36 user nova-compute[75006]:     <interface type='ethernet'>
Nov 27 03:23:36 user nova-compute[75006]:       <mac address='fa:16:3e:f1:20:08'/>
Nov 27 03:23:36 user nova-compute[75006]:       <target dev='tap252ba82d-08'/>
Nov 27 03:23:36 user nova-compute[75006]:       <model type='virtio'/>
Nov 27 03:23:36 user nova-compute[75006]:       <mtu size='1442'/>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='net1'/>
Nov 27 03:23:36 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </interface>
Nov 27 03:23:36 user nova-compute[75006]:     <serial type='pty'>
Nov 27 03:23:36 user nova-compute[75006]:       <source path='/dev/pts/9'/>
Nov 27 03:23:36 user nova-compute[75006]:       <log file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log' append='off'/>
Nov 27 03:23:36 user nova-compute[75006]:       <target type='isa-serial' port='0'>
Nov 27 03:23:36 user nova-compute[75006]:         <model name='isa-serial'/>
Nov 27 03:23:36 user nova-compute[75006]:       </target>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='serial0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </serial>
Nov 27 03:23:36 user nova-compute[75006]:     <console type='pty' tty='/dev/pts/9'>
Nov 27 03:23:36 user nova-compute[75006]:       <source path='/dev/pts/9'/>
Nov 27 03:23:36 user nova-compute[75006]:       <log file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log' append='off'/>
Nov 27 03:23:36 user nova-compute[75006]:       <target type='serial' port='0'/>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='serial0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </console>
Nov 27 03:23:36 user nova-compute[75006]:     <input type='mouse' bus='ps2'>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='input0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </input>
Nov 27 03:23:36 user nova-compute[75006]:     <input type='keyboard' bus='ps2'>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='input1'/>
Nov 27 03:23:36 user nova-compute[75006]:     </input>
Nov 27 03:23:36 user nova-compute[75006]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 27 03:23:36 user nova-compute[75006]:       <listen type='address' address='0.0.0.0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </graphics>
Nov 27 03:23:36 user nova-compute[75006]:     <audio id='1' type='none'/>
Nov 27 03:23:36 user nova-compute[75006]:     <video>
Nov 27 03:23:36 user nova-compute[75006]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='video0'/>
Nov 27 03:23:36 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </video>
Nov 27 03:23:36 user nova-compute[75006]:     <memballoon model='virtio'>
Nov 27 03:23:36 user nova-compute[75006]:       <stats period='10'/>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='balloon0'/>
Nov 27 03:23:36 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </memballoon>
Nov 27 03:23:36 user nova-compute[75006]:     <rng model='virtio'>
Nov 27 03:23:36 user nova-compute[75006]:       <backend model='random'>/dev/urandom</backend>
Nov 27 03:23:36 user nova-compute[75006]:       <alias name='rng0'/>
Nov 27 03:23:36 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 03:23:36 user nova-compute[75006]:     </rng>
Nov 27 03:23:36 user nova-compute[75006]:   </devices>
Nov 27 03:23:36 user nova-compute[75006]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 03:23:36 user nova-compute[75006]:     <label>libvirt-7b4d808c-beca-4008-8733-31afc9b26d80</label>
Nov 27 03:23:36 user nova-compute[75006]:     <imagelabel>libvirt-7b4d808c-beca-4008-8733-31afc9b26d80</imagelabel>
Nov 27 03:23:36 user nova-compute[75006]:   </seclabel>
Nov 27 03:23:36 user nova-compute[75006]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 03:23:36 user nova-compute[75006]:     <label>+64055:+108</label>
Nov 27 03:23:36 user nova-compute[75006]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 03:23:36 user nova-compute[75006]:   </seclabel>
Nov 27 03:23:36 user nova-compute[75006]: </domain>
Nov 27 03:23:36 user nova-compute[75006]:  {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 03:23:36 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Successfully detached device tap252ba82d-08 from instance 7b4d808c-beca-4008-8733-31afc9b26d80 from the persistent domain config.
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] (1/8): Attempting to detach device tap252ba82d-08 with device alias net1 from instance 7b4d808c-beca-4008-8733-31afc9b26d80 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] detach device xml: <interface type="ethernet">
Nov 27 03:23:36 user nova-compute[75006]:   <mac address="fa:16:3e:f1:20:08"/>
Nov 27 03:23:36 user nova-compute[75006]:   <model type="virtio"/>
Nov 27 03:23:36 user nova-compute[75006]:   <mtu size="1442"/>
Nov 27 03:23:36 user nova-compute[75006]:   <target dev="tap252ba82d-08"/>
Nov 27 03:23:36 user nova-compute[75006]: </interface>
Nov 27 03:23:36 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updating instance_info_cache with network_info: [{"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Releasing lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Instance network_info: |[{"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2e2d59f6-1f36-4f37-a7d4-58c6e2982372 req-3a858868-ad35-4ed4-a9d4-326880854c5e service nova] Acquired lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.neutron [req-2e2d59f6-1f36-4f37-a7d4-58c6e2982372 req-3a858868-ad35-4ed4-a9d4-326880854c5e service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Refreshing network info cache for port 1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Start _get_guest_xml network_info=[{"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:23:36 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:23:36 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1802484279',display_name='tempest-TestServerVolumeAttachmentScenario-server-1802484279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1802484279',id=20,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAymbzw2TbqeQ1Si9sioS0k6okcAOTMn/mIzUtRzfrZfva86zYB1vtG0StrsoXkyokIUBRtZed9vOzDzZpOM4W91Uv1TzwTAmGY7Z65X2Au7XAZ2aYlwWDJ/dXB/c6Dww==',key_name='tempest-keypair-326478977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ecd6ee9712450f9baaecf096a510ad',ramdisk_id='',reservation_id='r-7n9w6ag8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2131034638',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2131034638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b516ef03ccc4fd1be4195d9b4cd35b1',uuid=4921430a-67cc-418f-932f-c7249c8d2b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Converting VIF {"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a9:82,bridge_name='br-int',has_traffic_filtering=True,id=1a39f5fd-b558-47c4-bda3-3248d68aa175,network=Network(d060a651-af88-4342-a1cd-c59ebeda4c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a39f5fd-b5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lazy-loading 'pci_devices' on Instance uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:23:36 user nova-compute[75006]:   <uuid>4921430a-67cc-418f-932f-c7249c8d2b31</uuid>
Nov 27 03:23:36 user nova-compute[75006]:   <name>instance-00000014</name>
Nov 27 03:23:36 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:23:36 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:23:36 user nova-compute[75006]:   <metadata>
Nov 27 03:23:36 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:23:36 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:23:36 user nova-compute[75006]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1802484279</nova:name>
Nov 27 03:23:36 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:23:36</nova:creationTime>
Nov 27 03:23:36 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:23:36 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:23:36 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:23:36 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:23:36 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:23:36 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:23:36 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:23:36 user nova-compute[75006]:       <nova:owner>
Nov 27 03:23:36 user nova-compute[75006]:         <nova:user uuid="6b516ef03ccc4fd1be4195d9b4cd35b1">tempest-TestServerVolumeAttachmentScenario-2131034638-project-member</nova:user>
Nov 27 03:23:36 user nova-compute[75006]:         <nova:project uuid="d9ecd6ee9712450f9baaecf096a510ad">tempest-TestServerVolumeAttachmentScenario-2131034638</nova:project>
Nov 27 03:23:36 user nova-compute[75006]:       </nova:owner>
Nov 27 03:23:36 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:23:36 user nova-compute[75006]:       <nova:ports>
Nov 27 03:23:36 user nova-compute[75006]:         <nova:port uuid="1a39f5fd-b558-47c4-bda3-3248d68aa175">
Nov 27 03:23:36 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 03:23:36 user nova-compute[75006]:         </nova:port>
Nov 27 03:23:36 user nova-compute[75006]:       </nova:ports>
Nov 27 03:23:36 user nova-compute[75006]:     </nova:instance>
Nov 27 03:23:36 user nova-compute[75006]:   </metadata>
Nov 27 03:23:36 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:23:36 user nova-compute[75006]:     <system>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name="serial">4921430a-67cc-418f-932f-c7249c8d2b31</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name="uuid">4921430a-67cc-418f-932f-c7249c8d2b31</entry>
Nov 27 03:23:36 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:23:36 user nova-compute[75006]:     </system>
Nov 27 03:23:36 user nova-compute[75006]:   </sysinfo>
Nov 27 03:23:36 user nova-compute[75006]:   <os>
Nov 27 03:23:36 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:23:36 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:23:36 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:23:36 user nova-compute[75006]:   </os>
Nov 27 03:23:36 user nova-compute[75006]:   <features>
Nov 27 03:23:36 user nova-compute[75006]:     <acpi/>
Nov 27 03:23:36 user nova-compute[75006]:     <apic/>
Nov 27 03:23:36 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:23:36 user nova-compute[75006]:   </features>
Nov 27 03:23:36 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:23:36 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:23:36 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:23:36 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:23:36 user nova-compute[75006]:   </clock>
Nov 27 03:23:36 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:23:36 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:23:36 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:23:36 user nova-compute[75006]:   </cpu>
Nov 27 03:23:36 user nova-compute[75006]:   <devices>
Nov 27 03:23:36 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:23:36 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:23:36 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk"/>
Nov 27 03:23:36 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:23:36 user nova-compute[75006]:     </disk>
Nov 27 03:23:36 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:23:36 user nova-compute[75006]:       <mac address="fa:16:3e:f3:a9:82"/>
Nov 27 03:23:36 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:23:36 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:23:36 user nova-compute[75006]:       <target dev="tap1a39f5fd-b5"/>
Nov 27 03:23:36 user nova-compute[75006]:     </interface>
Nov 27 03:23:36 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:23:36 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/console.log" append="off"/>
Nov 27 03:23:36 user nova-compute[75006]:     </serial>
Nov 27 03:23:36 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:23:36 user nova-compute[75006]:     <video>
Nov 27 03:23:36 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:23:36 user nova-compute[75006]:     </video>
Nov 27 03:23:36 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:23:36 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:23:36 user nova-compute[75006]:     </rng>
Nov 27 03:23:36 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:23:36 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:23:36 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:23:36 user nova-compute[75006]:     </memballoon>
Nov 27 03:23:36 user nova-compute[75006]:   </devices>
Nov 27 03:23:36 user nova-compute[75006]: </domain>
Nov 27 03:23:36 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1802484279',display_name='tempest-TestServerVolumeAttachmentScenario-server-1802484279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1802484279',id=20,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAymbzw2TbqeQ1Si9sioS0k6okcAOTMn/mIzUtRzfrZfva86zYB1vtG0StrsoXkyokIUBRtZed9vOzDzZpOM4W91Uv1TzwTAmGY7Z65X2Au7XAZ2aYlwWDJ/dXB/c6Dww==',key_name='tempest-keypair-326478977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ecd6ee9712450f9baaecf096a510ad',ramdisk_id='',reservation_id='r-7n9w6ag8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2131034638',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2131034638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:23:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b516ef03ccc4fd1be4195d9b4cd35b1',uuid=4921430a-67cc-418f-932f-c7249c8d2b31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Converting VIF {"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a9:82,bridge_name='br-int',has_traffic_filtering=True,id=1a39f5fd-b558-47c4-bda3-3248d68aa175,network=Network(d060a651-af88-4342-a1cd-c59ebeda4c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a39f5fd-b5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG os_vif [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a9:82,bridge_name='br-int',has_traffic_filtering=True,id=1a39f5fd-b558-47c4-bda3-3248d68aa175,network=Network(d060a651-af88-4342-a1cd-c59ebeda4c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a39f5fd-b5') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92dd317b-488f-5b10-9201-e672a609d51f', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Start waiting for the detach event from libvirt for device tap252ba82d-08 with device alias net1 for instance 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a39f5fd-b5, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a39f5fd-b5, col_values=(('qos', UUID('caea1c8e-67ce-4217-a33d-8090617c98e6')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a39f5fd-b5, col_values=(('external_ids', {'iface-id': '1a39f5fd-b558-47c4-bda3-3248d68aa175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:a9:82', 'vm-uuid': '4921430a-67cc-418f-932f-c7249c8d2b31'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:36 user nova-compute[75006]: INFO os_vif [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:a9:82,bridge_name='br-int',has_traffic_filtering=True,id=1a39f5fd-b558-47c4-bda3-3248d68aa175,network=Network(d060a651-af88-4342-a1cd-c59ebeda4c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a39f5fd-b5')
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:23:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No VIF found with MAC fa:16:3e:f3:a9:82, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:23:37 user nova-compute[75006]: DEBUG nova.network.neutron [req-2e2d59f6-1f36-4f37-a7d4-58c6e2982372 req-3a858868-ad35-4ed4-a9d4-326880854c5e service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updated VIF entry in instance network info cache for port 1a39f5fd-b558-47c4-bda3-3248d68aa175. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:23:37 user nova-compute[75006]: DEBUG nova.network.neutron [req-2e2d59f6-1f36-4f37-a7d4-58c6e2982372 req-3a858868-ad35-4ed4-a9d4-326880854c5e service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updating instance_info_cache with network_info: [{"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2e2d59f6-1f36-4f37-a7d4-58c6e2982372 req-3a858868-ad35-4ed4-a9d4-326880854c5e service nova] Releasing lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-unplugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] No waiting events found dispatching network-vif-unplugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:38 user nova-compute[75006]: WARNING nova.compute.manager [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received unexpected event network-vif-unplugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 for instance with vm_state active and task_state None.
Nov 27 03:23:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] No waiting events found dispatching network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:38 user nova-compute[75006]: WARNING nova.compute.manager [req-b07f0369-28ee-4cdc-8a35-2746a414f62b req-d6e05755-4ef6-4da6-8a18-3a991d90d331 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received unexpected event network-vif-plugged-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 for instance with vm_state active and task_state None.
Nov 27 03:23:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6165d3f0-9d81-4ac4-8ac6-904c680c0672 req-6c2915f0-7481-477d-87e4-7f38cc191395 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Received event network-vif-plugged-1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6165d3f0-9d81-4ac4-8ac6-904c680c0672 req-6c2915f0-7481-477d-87e4-7f38cc191395 service nova] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6165d3f0-9d81-4ac4-8ac6-904c680c0672 req-6c2915f0-7481-477d-87e4-7f38cc191395 service nova] Lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6165d3f0-9d81-4ac4-8ac6-904c680c0672 req-6c2915f0-7481-477d-87e4-7f38cc191395 service nova] Lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6165d3f0-9d81-4ac4-8ac6-904c680c0672 req-6c2915f0-7481-477d-87e4-7f38cc191395 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] No waiting events found dispatching network-vif-plugged-1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:38 user nova-compute[75006]: WARNING nova.compute.manager [req-6165d3f0-9d81-4ac4-8ac6-904c680c0672 req-6c2915f0-7481-477d-87e4-7f38cc191395 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Received unexpected event network-vif-plugged-1a39f5fd-b558-47c4-bda3-3248d68aa175 for instance with vm_state building and task_state spawning.
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:39 user nova-compute[75006]: INFO nova.compute.manager [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Terminating instance
Nov 27 03:23:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-89d0bc6c-c0d6-4f6a-bf55-8b8f98998d81 req-3cbe4aec-9a6c-44a4-8b2c-a13596283601 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received event network-vif-unplugged-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-89d0bc6c-c0d6-4f6a-bf55-8b8f98998d81 req-3cbe4aec-9a6c-44a4-8b2c-a13596283601 service nova] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-89d0bc6c-c0d6-4f6a-bf55-8b8f98998d81 req-3cbe4aec-9a6c-44a4-8b2c-a13596283601 service nova] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-89d0bc6c-c0d6-4f6a-bf55-8b8f98998d81 req-3cbe4aec-9a6c-44a4-8b2c-a13596283601 service nova] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-89d0bc6c-c0d6-4f6a-bf55-8b8f98998d81 req-3cbe4aec-9a6c-44a4-8b2c-a13596283601 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] No waiting events found dispatching network-vif-unplugged-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-89d0bc6c-c0d6-4f6a-bf55-8b8f98998d81 req-3cbe4aec-9a6c-44a4-8b2c-a13596283601 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received event network-vif-unplugged-fe877835-a1ab-434a-8eff-de1db84f2425 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:23:40 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Instance destroyed successfully.
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.objects.instance [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'resources' on Instance uuid 5ee0634e-e918-4e98-a42c-496e3f7de095 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2137649091',display_name='tempest-AttachVolumeNegativeTest-server-2137649091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2137649091',id=4,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdXLzYXwviu59yTMlRhbT80OhEGYiBawXlZpIm/cVX7TnUJ/2eKns0D1T7aNNU6CH0+MT27NbRiIqIY+KmkATNnqNRbEmiuni+AsE1b5zTUCXj0SyxaMFIfaYDDZrG5gQ==',key_name='tempest-keypair-834301241',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-h5g1ef6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=5ee0634e-e918-4e98-a42c-496e3f7de095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "fe877835-a1ab-434a-8eff-de1db84f2425", "address": "fa:16:3e:1b:c7:bd", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe877835-a1", "ovs_interfaceid": "fe877835-a1ab-434a-8eff-de1db84f2425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:c7:bd,bridge_name='br-int',has_traffic_filtering=True,id=fe877835-a1ab-434a-8eff-de1db84f2425,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe877835-a1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG os_vif [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:c7:bd,bridge_name='br-int',has_traffic_filtering=True,id=fe877835-a1ab-434a-8eff-de1db84f2425,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe877835-a1') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe877835-a1, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a856ea06-7a21-4938-82b6-47befe1f0375) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:40 user nova-compute[75006]: INFO os_vif [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:c7:bd,bridge_name='br-int',has_traffic_filtering=True,id=fe877835-a1ab-434a-8eff-de1db84f2425,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe877835-a1')
Nov 27 03:23:40 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Deleting instance files /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095_del
Nov 27 03:23:40 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Deletion of /opt/stack/data/nova/instances/5ee0634e-e918-4e98-a42c-496e3f7de095_del complete
Nov 27 03:23:40 user nova-compute[75006]: INFO nova.compute.manager [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 03:23:40 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-8cea4f79-a393-4fb3-85c9-497664322214 req-5f09c206-7674-4198-9caa-abb50ac6fd87 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Received event network-vif-plugged-1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8cea4f79-a393-4fb3-85c9-497664322214 req-5f09c206-7674-4198-9caa-abb50ac6fd87 service nova] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8cea4f79-a393-4fb3-85c9-497664322214 req-5f09c206-7674-4198-9caa-abb50ac6fd87 service nova] Lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8cea4f79-a393-4fb3-85c9-497664322214 req-5f09c206-7674-4198-9caa-abb50ac6fd87 service nova] Lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-8cea4f79-a393-4fb3-85c9-497664322214 req-5f09c206-7674-4198-9caa-abb50ac6fd87 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] No waiting events found dispatching network-vif-plugged-1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:40 user nova-compute[75006]: WARNING nova.compute.manager [req-8cea4f79-a393-4fb3-85c9-497664322214 req-5f09c206-7674-4198-9caa-abb50ac6fd87 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Received unexpected event network-vif-plugged-1a39f5fd-b558-47c4-bda3-3248d68aa175 for instance with vm_state building and task_state spawning.
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:23:40 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Instance spawned successfully.
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:23:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:23:41 user nova-compute[75006]: INFO nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 27 03:23:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:23:41 user nova-compute[75006]: INFO nova.compute.manager [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Took 7.03 seconds to build instance.
Nov 27 03:23:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e79408f-734a-453f-8361-b3f1f5e88b61 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.182s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:41 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Took 0.99 seconds to deallocate network for instance.
Nov 27 03:23:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c9aab4b-8b1d-4a34-aeac-ab48459a32f2 req-140a97f0-2ad7-4968-8233-62c7bf2790e7 service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received event network-vif-deleted-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:41 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Deleted allocations for instance 5ee0634e-e918-4e98-a42c-496e3f7de095
Nov 27 03:23:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-073b8e1d-caf6-401e-a7d7-41a150ece0e0 req-1fdf0f5f-5929-460a-ba85-6eb333448c1b service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received event network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-073b8e1d-caf6-401e-a7d7-41a150ece0e0 req-1fdf0f5f-5929-460a-ba85-6eb333448c1b service nova] Acquiring lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-073b8e1d-caf6-401e-a7d7-41a150ece0e0 req-1fdf0f5f-5929-460a-ba85-6eb333448c1b service nova] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-073b8e1d-caf6-401e-a7d7-41a150ece0e0 req-1fdf0f5f-5929-460a-ba85-6eb333448c1b service nova] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-073b8e1d-caf6-401e-a7d7-41a150ece0e0 req-1fdf0f5f-5929-460a-ba85-6eb333448c1b service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] No waiting events found dispatching network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:41 user nova-compute[75006]: WARNING nova.compute.manager [req-073b8e1d-caf6-401e-a7d7-41a150ece0e0 req-1fdf0f5f-5929-460a-ba85-6eb333448c1b service nova] [instance: 5ee0634e-e918-4e98-a42c-496e3f7de095] Received unexpected event network-vif-plugged-fe877835-a1ab-434a-8eff-de1db84f2425 for instance with vm_state deleted and task_state None.
Nov 27 03:23:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-cdca1fb2-5229-4412-b498-05f9fe4348af tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "5ee0634e-e918-4e98-a42c-496e3f7de095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.514s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:23:43 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:44 user nova-compute[75006]: INFO nova.compute.manager [None req-4aad0dbf-8560-4c36-a747-c67547891a8c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Unrescuing
Nov 27 03:23:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4aad0dbf-8560-4c36-a747-c67547891a8c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4aad0dbf-8560-4c36-a747-c67547891a8c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquired lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-4aad0dbf-8560-4c36-a747-c67547891a8c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:44 user nova-compute[75006]: INFO nova.compute.manager [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Detaching volume 2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:23:44 user nova-compute[75006]: INFO nova.virt.block_device [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Attempting to driver detach volume 2500f817-c1b9-4704-b404-22a17c6a0231 from mountpoint /dev/vdb
Nov 27 03:23:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Attempting to detach device vdb from instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:23:44 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:23:44 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:23:44 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:23:44 user nova-compute[75006]:   <serial>2500f817-c1b9-4704-b404-22a17c6a0231</serial>
Nov 27 03:23:44 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 03:23:44 user nova-compute[75006]: </disk>
Nov 27 03:23:44 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:23:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully detached device vdb from instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 from the persistent domain config.
Nov 27 03:23:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:23:44 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:23:44 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:23:44 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:23:44 user nova-compute[75006]:   <serial>2500f817-c1b9-4704-b404-22a17c6a0231</serial>
Nov 27 03:23:44 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 03:23:44 user nova-compute[75006]: </disk>
Nov 27 03:23:44 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-4aad0dbf-8560-4c36-a747-c67547891a8c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4aad0dbf-8560-4c36-a747-c67547891a8c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Releasing lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG nova.objects.instance [None req-4aad0dbf-8560-4c36-a747-c67547891a8c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'flavor' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-f107e72e-7f68-4d9b-ab0d-c850282cb634 req-ce58df18-4bc8-4491-ba10-fbc077e426d0 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f107e72e-7f68-4d9b-ab0d-c850282cb634 req-ce58df18-4bc8-4491-ba10-fbc077e426d0 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f107e72e-7f68-4d9b-ab0d-c850282cb634 req-ce58df18-4bc8-4491-ba10-fbc077e426d0 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f107e72e-7f68-4d9b-ab0d-c850282cb634 req-ce58df18-4bc8-4491-ba10-fbc077e426d0 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-f107e72e-7f68-4d9b-ab0d-c850282cb634 req-ce58df18-4bc8-4491-ba10-fbc077e426d0 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:45 user nova-compute[75006]: WARNING nova.compute.manager [req-f107e72e-7f68-4d9b-ab0d-c850282cb634 req-ce58df18-4bc8-4491-ba10-fbc077e426d0 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:23:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-d2bb0d87-2149-478d-9fa2-d0006cfb2572 req-0b29e1de-1188-440f-bdcf-ea7fd5dfd1d4 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-changed-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-d2bb0d87-2149-478d-9fa2-d0006cfb2572 req-0b29e1de-1188-440f-bdcf-ea7fd5dfd1d4 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Refreshing instance network info cache due to event network-changed-f94812d5-e03a-40d6-88c1-6fe71880aa1d. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d2bb0d87-2149-478d-9fa2-d0006cfb2572 req-0b29e1de-1188-440f-bdcf-ea7fd5dfd1d4 service nova] Acquiring lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d2bb0d87-2149-478d-9fa2-d0006cfb2572 req-0b29e1de-1188-440f-bdcf-ea7fd5dfd1d4 service nova] Acquired lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG nova.network.neutron [req-d2bb0d87-2149-478d-9fa2-d0006cfb2572 req-0b29e1de-1188-440f-bdcf-ea7fd5dfd1d4 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Refreshing network info cache for port f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:23:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance destroyed successfully.
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:45 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:23:46 user nova-compute[75006]: DEBUG nova.network.neutron [req-d2bb0d87-2149-478d-9fa2-d0006cfb2572 req-0b29e1de-1188-440f-bdcf-ea7fd5dfd1d4 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updated VIF entry in instance network info cache for port f94812d5-e03a-40d6-88c1-6fe71880aa1d. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:23:46 user nova-compute[75006]: DEBUG nova.network.neutron [req-d2bb0d87-2149-478d-9fa2-d0006cfb2572 req-0b29e1de-1188-440f-bdcf-ea7fd5dfd1d4 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d2bb0d87-2149-478d-9fa2-d0006cfb2572 req-0b29e1de-1188-440f-bdcf-ea7fd5dfd1d4 service nova] Releasing lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-02e7988e-17cc-444c-ba47-acfeb1b64cb5 req-c94d3bcf-088b-44ec-bf62-a2b0bd8b7ff9 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-02e7988e-17cc-444c-ba47-acfeb1b64cb5 req-c94d3bcf-088b-44ec-bf62-a2b0bd8b7ff9 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-02e7988e-17cc-444c-ba47-acfeb1b64cb5 req-c94d3bcf-088b-44ec-bf62-a2b0bd8b7ff9 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-02e7988e-17cc-444c-ba47-acfeb1b64cb5 req-c94d3bcf-088b-44ec-bf62-a2b0bd8b7ff9 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-02e7988e-17cc-444c-ba47-acfeb1b64cb5 req-c94d3bcf-088b-44ec-bf62-a2b0bd8b7ff9 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:47 user nova-compute[75006]: WARNING nova.compute.manager [req-02e7988e-17cc-444c-ba47-acfeb1b64cb5 req-c94d3bcf-088b-44ec-bf62-a2b0bd8b7ff9 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:23:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-fa616ca4-3e94-42f1-9f44-bd52d8128a9c req-4e001370-a152-41f1-9f3d-ef635771b796 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-changed-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-fa616ca4-3e94-42f1-9f44-bd52d8128a9c req-4e001370-a152-41f1-9f3d-ef635771b796 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Refreshing instance network info cache due to event network-changed-f94812d5-e03a-40d6-88c1-6fe71880aa1d. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa616ca4-3e94-42f1-9f44-bd52d8128a9c req-4e001370-a152-41f1-9f3d-ef635771b796 service nova] Acquiring lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa616ca4-3e94-42f1-9f44-bd52d8128a9c req-4e001370-a152-41f1-9f3d-ef635771b796 service nova] Acquired lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG nova.network.neutron [req-fa616ca4-3e94-42f1-9f44-bd52d8128a9c req-4e001370-a152-41f1-9f3d-ef635771b796 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Refreshing network info cache for port f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:48 user nova-compute[75006]: DEBUG nova.network.neutron [req-fa616ca4-3e94-42f1-9f44-bd52d8128a9c req-4e001370-a152-41f1-9f3d-ef635771b796 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updated VIF entry in instance network info cache for port f94812d5-e03a-40d6-88c1-6fe71880aa1d. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:23:48 user nova-compute[75006]: DEBUG nova.network.neutron [req-fa616ca4-3e94-42f1-9f44-bd52d8128a9c req-4e001370-a152-41f1-9f3d-ef635771b796 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [{"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa616ca4-3e94-42f1-9f44-bd52d8128a9c req-4e001370-a152-41f1-9f3d-ef635771b796 service nova] Releasing lock "refresh_cache-fa069296-0bb8-4b82-bedf-d1a8d8cd104e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:49 user nova-compute[75006]: WARNING nova.compute.manager [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:23:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:49 user nova-compute[75006]: WARNING nova.compute.manager [req-f5df9bd7-0600-4f77-b2ef-9f63401d58ac req-4508bd73-13f5-4f37-a5db-b70f295608c3 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:23:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4aad0dbf-8560-4c36-a747-c67547891a8c tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-8029cace-4dd7-4862-b49a-fa71105f5edf req-db696845-dd7c-43e1-adb8-2bde1d6c1903 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-changed-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-8029cace-4dd7-4862-b49a-fa71105f5edf req-db696845-dd7c-43e1-adb8-2bde1d6c1903 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Refreshing instance network info cache due to event network-changed-01db2ae6-9b70-456e-aaa3-ecec258c0a00. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8029cace-4dd7-4862-b49a-fa71105f5edf req-db696845-dd7c-43e1-adb8-2bde1d6c1903 service nova] Acquiring lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8029cace-4dd7-4862-b49a-fa71105f5edf req-db696845-dd7c-43e1-adb8-2bde1d6c1903 service nova] Acquired lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG nova.network.neutron [req-8029cace-4dd7-4862-b49a-fa71105f5edf req-db696845-dd7c-43e1-adb8-2bde1d6c1903 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Refreshing network info cache for port 01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-8029cace-4dd7-4862-b49a-fa71105f5edf req-db696845-dd7c-43e1-adb8-2bde1d6c1903 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updated VIF entry in instance network info cache for port 01db2ae6-9b70-456e-aaa3-ecec258c0a00. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-8029cace-4dd7-4862-b49a-fa71105f5edf req-db696845-dd7c-43e1-adb8-2bde1d6c1903 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8029cace-4dd7-4862-b49a-fa71105f5edf req-db696845-dd7c-43e1-adb8-2bde1d6c1903 service nova] Releasing lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:23:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:23:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:23:53 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:23:53 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:23:53 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=25.427169799804688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:23:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fd992ae2-0b97-47d2-9e03-f707af65f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 7b4d808c-beca-4008-8733-31afc9b26d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 4921430a-67cc-418f-932f-c7249c8d2b31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:23:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:23:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updating instance_info_cache with network_info: [{"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:23:56 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Waiting for libvirt event about the detach of device tap252ba82d-08 with device alias net1 from instance 7b4d808c-beca-4008-8733-31afc9b26d80 is timed out.
Nov 27 03:23:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface> {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 27 03:23:56 user nova-compute[75006]:   <name>instance-0000000f</name>
Nov 27 03:23:56 user nova-compute[75006]:   <uuid>7b4d808c-beca-4008-8733-31afc9b26d80</uuid>
Nov 27 03:23:56 user nova-compute[75006]:   <metadata>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:23:56 user nova-compute[75006]:   <nova:package version="0.0.0"/>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:name>tempest-device-tagging-server-1358855801</nova:name>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:creationTime>2023-11-27 03:23:02</nova:creationTime>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:flavor name="m1.tiny">
Nov 27 03:23:56 user nova-compute[75006]:     <nova:memory>512</nova:memory>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:disk>1</nova:disk>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:swap>0</nova:swap>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:vcpus>1</nova:vcpus>
Nov 27 03:23:56 user nova-compute[75006]:   </nova:flavor>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:owner>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:user uuid="8fe95d495e394f6094f76fa8a9bdf8a0">tempest-TaggedAttachmentsTest-2115441077-project-member</nova:user>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:project uuid="cec104eb22944c46a2ed69b13fc26eec">tempest-TaggedAttachmentsTest-2115441077</nova:project>
Nov 27 03:23:56 user nova-compute[75006]:   </nova:owner>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:ports>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:port uuid="1ede6185-835b-45f8-a691-5d49116fdd90">
Nov 27 03:23:56 user nova-compute[75006]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:23:56 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:port uuid="252ba82d-08ad-4ebe-add5-55dc9e5c20c2">
Nov 27 03:23:56 user nova-compute[75006]:       <nova:ip type="fixed" address="10.10.10.184" ipVersion="4"/>
Nov 27 03:23:56 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:56 user nova-compute[75006]:   </nova:ports>
Nov 27 03:23:56 user nova-compute[75006]: </nova:instance>
Nov 27 03:23:56 user nova-compute[75006]:   </metadata>
Nov 27 03:23:56 user nova-compute[75006]:   <memory unit='KiB'>524288</memory>
Nov 27 03:23:56 user nova-compute[75006]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 03:23:56 user nova-compute[75006]:   <vcpu placement='static'>1</vcpu>
Nov 27 03:23:56 user nova-compute[75006]:   <resource>
Nov 27 03:23:56 user nova-compute[75006]:     <partition>/machine</partition>
Nov 27 03:23:56 user nova-compute[75006]:   </resource>
Nov 27 03:23:56 user nova-compute[75006]:   <sysinfo type='smbios'>
Nov 27 03:23:56 user nova-compute[75006]:     <system>
Nov 27 03:23:56 user nova-compute[75006]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 03:23:56 user nova-compute[75006]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 03:23:56 user nova-compute[75006]:       <entry name='version'>0.0.0</entry>
Nov 27 03:23:56 user nova-compute[75006]:       <entry name='serial'>7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:23:56 user nova-compute[75006]:       <entry name='uuid'>7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:23:56 user nova-compute[75006]:       <entry name='family'>Virtual Machine</entry>
Nov 27 03:23:56 user nova-compute[75006]:     </system>
Nov 27 03:23:56 user nova-compute[75006]:   </sysinfo>
Nov 27 03:23:56 user nova-compute[75006]:   <os>
Nov 27 03:23:56 user nova-compute[75006]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 03:23:56 user nova-compute[75006]:     <boot dev='hd'/>
Nov 27 03:23:56 user nova-compute[75006]:     <smbios mode='sysinfo'/>
Nov 27 03:23:56 user nova-compute[75006]:   </os>
Nov 27 03:23:56 user nova-compute[75006]:   <features>
Nov 27 03:23:56 user nova-compute[75006]:     <acpi/>
Nov 27 03:23:56 user nova-compute[75006]:     <apic/>
Nov 27 03:23:56 user nova-compute[75006]:     <vmcoreinfo state='on'/>
Nov 27 03:23:56 user nova-compute[75006]:   </features>
Nov 27 03:23:56 user nova-compute[75006]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 03:23:56 user nova-compute[75006]:     <model fallback='forbid'>Nehalem</model>
Nov 27 03:23:56 user nova-compute[75006]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 03:23:56 user nova-compute[75006]:     <feature policy='require' name='vme'/>
Nov 27 03:23:56 user nova-compute[75006]:     <feature policy='require' name='x2apic'/>
Nov 27 03:23:56 user nova-compute[75006]:     <feature policy='require' name='hypervisor'/>
Nov 27 03:23:56 user nova-compute[75006]:   </cpu>
Nov 27 03:23:56 user nova-compute[75006]:   <clock offset='utc'>
Nov 27 03:23:56 user nova-compute[75006]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 03:23:56 user nova-compute[75006]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 03:23:56 user nova-compute[75006]:     <timer name='hpet' present='no'/>
Nov 27 03:23:56 user nova-compute[75006]:   </clock>
Nov 27 03:23:56 user nova-compute[75006]:   <on_poweroff>destroy</on_poweroff>
Nov 27 03:23:56 user nova-compute[75006]:   <on_reboot>restart</on_reboot>
Nov 27 03:23:56 user nova-compute[75006]:   <on_crash>destroy</on_crash>
Nov 27 03:23:56 user nova-compute[75006]:   <devices>
Nov 27 03:23:56 user nova-compute[75006]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 03:23:56 user nova-compute[75006]:     <disk type='file' device='disk'>
Nov 27 03:23:56 user nova-compute[75006]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 03:23:56 user nova-compute[75006]:       <source file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk' index='2'/>
Nov 27 03:23:56 user nova-compute[75006]:       <backingStore type='file' index='3'>
Nov 27 03:23:56 user nova-compute[75006]:         <format type='raw'/>
Nov 27 03:23:56 user nova-compute[75006]:         <source file='/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe'/>
Nov 27 03:23:56 user nova-compute[75006]:         <backingStore/>
Nov 27 03:23:56 user nova-compute[75006]:       </backingStore>
Nov 27 03:23:56 user nova-compute[75006]:       <target dev='vda' bus='virtio'/>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='virtio-disk0'/>
Nov 27 03:23:56 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </disk>
Nov 27 03:23:56 user nova-compute[75006]:     <disk type='file' device='cdrom'>
Nov 27 03:23:56 user nova-compute[75006]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 03:23:56 user nova-compute[75006]:       <source file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.config' index='1'/>
Nov 27 03:23:56 user nova-compute[75006]:       <backingStore/>
Nov 27 03:23:56 user nova-compute[75006]:       <target dev='hda' bus='ide'/>
Nov 27 03:23:56 user nova-compute[75006]:       <readonly/>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='ide0-0-0'/>
Nov 27 03:23:56 user nova-compute[75006]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </disk>
Nov 27 03:23:56 user nova-compute[75006]:     <controller type='usb' index='0' model='none'>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='usb'/>
Nov 27 03:23:56 user nova-compute[75006]:     </controller>
Nov 27 03:23:56 user nova-compute[75006]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='pci.0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </controller>
Nov 27 03:23:56 user nova-compute[75006]:     <controller type='ide' index='0'>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='ide'/>
Nov 27 03:23:56 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 03:23:56 user nova-compute[75006]:     </controller>
Nov 27 03:23:56 user nova-compute[75006]:     <interface type='ethernet'>
Nov 27 03:23:56 user nova-compute[75006]:       <mac address='fa:16:3e:72:63:dd'/>
Nov 27 03:23:56 user nova-compute[75006]:       <target dev='tap1ede6185-83'/>
Nov 27 03:23:56 user nova-compute[75006]:       <model type='virtio'/>
Nov 27 03:23:56 user nova-compute[75006]:       <mtu size='1442'/>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='net0'/>
Nov 27 03:23:56 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </interface>
Nov 27 03:23:56 user nova-compute[75006]:     <serial type='pty'>
Nov 27 03:23:56 user nova-compute[75006]:       <source path='/dev/pts/9'/>
Nov 27 03:23:56 user nova-compute[75006]:       <log file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log' append='off'/>
Nov 27 03:23:56 user nova-compute[75006]:       <target type='isa-serial' port='0'>
Nov 27 03:23:56 user nova-compute[75006]:         <model name='isa-serial'/>
Nov 27 03:23:56 user nova-compute[75006]:       </target>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='serial0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </serial>
Nov 27 03:23:56 user nova-compute[75006]:     <console type='pty' tty='/dev/pts/9'>
Nov 27 03:23:56 user nova-compute[75006]:       <source path='/dev/pts/9'/>
Nov 27 03:23:56 user nova-compute[75006]:       <log file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log' append='off'/>
Nov 27 03:23:56 user nova-compute[75006]:       <target type='serial' port='0'/>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='serial0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </console>
Nov 27 03:23:56 user nova-compute[75006]:     <input type='mouse' bus='ps2'>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='input0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </input>
Nov 27 03:23:56 user nova-compute[75006]:     <input type='keyboard' bus='ps2'>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='input1'/>
Nov 27 03:23:56 user nova-compute[75006]:     </input>
Nov 27 03:23:56 user nova-compute[75006]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 27 03:23:56 user nova-compute[75006]:       <listen type='address' address='0.0.0.0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </graphics>
Nov 27 03:23:56 user nova-compute[75006]:     <audio id='1' type='none'/>
Nov 27 03:23:56 user nova-compute[75006]:     <video>
Nov 27 03:23:56 user nova-compute[75006]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='video0'/>
Nov 27 03:23:56 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </video>
Nov 27 03:23:56 user nova-compute[75006]:     <memballoon model='virtio'>
Nov 27 03:23:56 user nova-compute[75006]:       <stats period='10'/>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='balloon0'/>
Nov 27 03:23:56 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </memballoon>
Nov 27 03:23:56 user nova-compute[75006]:     <rng model='virtio'>
Nov 27 03:23:56 user nova-compute[75006]:       <backend model='random'>/dev/urandom</backend>
Nov 27 03:23:56 user nova-compute[75006]:       <alias name='rng0'/>
Nov 27 03:23:56 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 03:23:56 user nova-compute[75006]:     </rng>
Nov 27 03:23:56 user nova-compute[75006]:   </devices>
Nov 27 03:23:56 user nova-compute[75006]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 03:23:56 user nova-compute[75006]:     <label>libvirt-7b4d808c-beca-4008-8733-31afc9b26d80</label>
Nov 27 03:23:56 user nova-compute[75006]:     <imagelabel>libvirt-7b4d808c-beca-4008-8733-31afc9b26d80</imagelabel>
Nov 27 03:23:56 user nova-compute[75006]:   </seclabel>
Nov 27 03:23:56 user nova-compute[75006]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 03:23:56 user nova-compute[75006]:     <label>+64055:+108</label>
Nov 27 03:23:56 user nova-compute[75006]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 03:23:56 user nova-compute[75006]:   </seclabel>
Nov 27 03:23:56 user nova-compute[75006]: </domain>
Nov 27 03:23:56 user nova-compute[75006]:  {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 03:23:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Successfully detached device tap252ba82d-08 from instance 7b4d808c-beca-4008-8733-31afc9b26d80 from the live domain config.
Nov 27 03:23:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converting VIF {"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG os_vif [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap252ba82d-08, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78ca4887-b107-4173-ac6e-ce19035ca84e) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:23:56 user nova-compute[75006]: INFO os_vif [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08')
Nov 27 03:23:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:23:56 user nova-compute[75006]:   <nova:package version="0.0.0"/>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:name>tempest-device-tagging-server-1358855801</nova:name>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:creationTime>2023-11-27 03:23:56</nova:creationTime>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:flavor name="m1.tiny">
Nov 27 03:23:56 user nova-compute[75006]:     <nova:memory>512</nova:memory>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:disk>1</nova:disk>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:swap>0</nova:swap>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:vcpus>1</nova:vcpus>
Nov 27 03:23:56 user nova-compute[75006]:   </nova:flavor>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:owner>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:user uuid="8fe95d495e394f6094f76fa8a9bdf8a0">tempest-TaggedAttachmentsTest-2115441077-project-member</nova:user>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:project uuid="cec104eb22944c46a2ed69b13fc26eec">tempest-TaggedAttachmentsTest-2115441077</nova:project>
Nov 27 03:23:56 user nova-compute[75006]:   </nova:owner>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:23:56 user nova-compute[75006]:   <nova:ports>
Nov 27 03:23:56 user nova-compute[75006]:     <nova:port uuid="1ede6185-835b-45f8-a691-5d49116fdd90">
Nov 27 03:23:56 user nova-compute[75006]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:23:56 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:56 user nova-compute[75006]:   </nova:ports>
Nov 27 03:23:56 user nova-compute[75006]: </nova:instance>
Nov 27 03:23:56 user nova-compute[75006]:  {{(pid=75006) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-deleted-252ba82d-08ad-4ebe-add5-55dc9e5c20c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:57 user nova-compute[75006]: INFO nova.compute.manager [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Neutron deleted interface 252ba82d-08ad-4ebe-add5-55dc9e5c20c2; detaching it from the instance and deleting it from the info cache
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating instance_info_cache with network_info: [{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquired lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.objects.instance [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Lazy-loading 'system_metadata' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.objects.instance [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Lazy-loading 'flavor' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.objects.base [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Object Instance<7b4d808c-beca-4008-8733-31afc9b26d80> lazy-loaded attributes: system_metadata,flavor {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.network.os_vif_util [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Converting VIF {"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.network.os_vif_util [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface> {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 27 03:23:57 user nova-compute[75006]:   <name>instance-0000000f</name>
Nov 27 03:23:57 user nova-compute[75006]:   <uuid>7b4d808c-beca-4008-8733-31afc9b26d80</uuid>
Nov 27 03:23:57 user nova-compute[75006]:   <metadata>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:23:57 user nova-compute[75006]:   <nova:package version="0.0.0"/>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:name>tempest-device-tagging-server-1358855801</nova:name>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:creationTime>2023-11-27 03:23:56</nova:creationTime>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:flavor name="m1.tiny">
Nov 27 03:23:57 user nova-compute[75006]:     <nova:memory>512</nova:memory>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:disk>1</nova:disk>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:swap>0</nova:swap>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:vcpus>1</nova:vcpus>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:flavor>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:owner>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:user uuid="8fe95d495e394f6094f76fa8a9bdf8a0">tempest-TaggedAttachmentsTest-2115441077-project-member</nova:user>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:project uuid="cec104eb22944c46a2ed69b13fc26eec">tempest-TaggedAttachmentsTest-2115441077</nova:project>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:owner>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:ports>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:port uuid="1ede6185-835b-45f8-a691-5d49116fdd90">
Nov 27 03:23:57 user nova-compute[75006]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:23:57 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:ports>
Nov 27 03:23:57 user nova-compute[75006]: </nova:instance>
Nov 27 03:23:57 user nova-compute[75006]:   </metadata>
Nov 27 03:23:57 user nova-compute[75006]:   <memory unit='KiB'>524288</memory>
Nov 27 03:23:57 user nova-compute[75006]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 03:23:57 user nova-compute[75006]:   <vcpu placement='static'>1</vcpu>
Nov 27 03:23:57 user nova-compute[75006]:   <resource>
Nov 27 03:23:57 user nova-compute[75006]:     <partition>/machine</partition>
Nov 27 03:23:57 user nova-compute[75006]:   </resource>
Nov 27 03:23:57 user nova-compute[75006]:   <sysinfo type='smbios'>
Nov 27 03:23:57 user nova-compute[75006]:     <system>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='version'>0.0.0</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='serial'>7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='uuid'>7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='family'>Virtual Machine</entry>
Nov 27 03:23:57 user nova-compute[75006]:     </system>
Nov 27 03:23:57 user nova-compute[75006]:   </sysinfo>
Nov 27 03:23:57 user nova-compute[75006]:   <os>
Nov 27 03:23:57 user nova-compute[75006]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 03:23:57 user nova-compute[75006]:     <boot dev='hd'/>
Nov 27 03:23:57 user nova-compute[75006]:     <smbios mode='sysinfo'/>
Nov 27 03:23:57 user nova-compute[75006]:   </os>
Nov 27 03:23:57 user nova-compute[75006]:   <features>
Nov 27 03:23:57 user nova-compute[75006]:     <acpi/>
Nov 27 03:23:57 user nova-compute[75006]:     <apic/>
Nov 27 03:23:57 user nova-compute[75006]:     <vmcoreinfo state='on'/>
Nov 27 03:23:57 user nova-compute[75006]:   </features>
Nov 27 03:23:57 user nova-compute[75006]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 03:23:57 user nova-compute[75006]:     <model fallback='forbid'>Nehalem</model>
Nov 27 03:23:57 user nova-compute[75006]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 03:23:57 user nova-compute[75006]:     <feature policy='require' name='vme'/>
Nov 27 03:23:57 user nova-compute[75006]:     <feature policy='require' name='x2apic'/>
Nov 27 03:23:57 user nova-compute[75006]:     <feature policy='require' name='hypervisor'/>
Nov 27 03:23:57 user nova-compute[75006]:   </cpu>
Nov 27 03:23:57 user nova-compute[75006]:   <clock offset='utc'>
Nov 27 03:23:57 user nova-compute[75006]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 03:23:57 user nova-compute[75006]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 03:23:57 user nova-compute[75006]:     <timer name='hpet' present='no'/>
Nov 27 03:23:57 user nova-compute[75006]:   </clock>
Nov 27 03:23:57 user nova-compute[75006]:   <on_poweroff>destroy</on_poweroff>
Nov 27 03:23:57 user nova-compute[75006]:   <on_reboot>restart</on_reboot>
Nov 27 03:23:57 user nova-compute[75006]:   <on_crash>destroy</on_crash>
Nov 27 03:23:57 user nova-compute[75006]:   <devices>
Nov 27 03:23:57 user nova-compute[75006]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 03:23:57 user nova-compute[75006]:     <disk type='file' device='disk'>
Nov 27 03:23:57 user nova-compute[75006]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 03:23:57 user nova-compute[75006]:       <source file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk' index='2'/>
Nov 27 03:23:57 user nova-compute[75006]:       <backingStore type='file' index='3'>
Nov 27 03:23:57 user nova-compute[75006]:         <format type='raw'/>
Nov 27 03:23:57 user nova-compute[75006]:         <source file='/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe'/>
Nov 27 03:23:57 user nova-compute[75006]:         <backingStore/>
Nov 27 03:23:57 user nova-compute[75006]:       </backingStore>
Nov 27 03:23:57 user nova-compute[75006]:       <target dev='vda' bus='virtio'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='virtio-disk0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </disk>
Nov 27 03:23:57 user nova-compute[75006]:     <disk type='file' device='cdrom'>
Nov 27 03:23:57 user nova-compute[75006]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 03:23:57 user nova-compute[75006]:       <source file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.config' index='1'/>
Nov 27 03:23:57 user nova-compute[75006]:       <backingStore/>
Nov 27 03:23:57 user nova-compute[75006]:       <target dev='hda' bus='ide'/>
Nov 27 03:23:57 user nova-compute[75006]:       <readonly/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='ide0-0-0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </disk>
Nov 27 03:23:57 user nova-compute[75006]:     <controller type='usb' index='0' model='none'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='usb'/>
Nov 27 03:23:57 user nova-compute[75006]:     </controller>
Nov 27 03:23:57 user nova-compute[75006]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='pci.0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </controller>
Nov 27 03:23:57 user nova-compute[75006]:     <controller type='ide' index='0'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='ide'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 03:23:57 user nova-compute[75006]:     </controller>
Nov 27 03:23:57 user nova-compute[75006]:     <interface type='ethernet'>
Nov 27 03:23:57 user nova-compute[75006]:       <mac address='fa:16:3e:72:63:dd'/>
Nov 27 03:23:57 user nova-compute[75006]:       <target dev='tap1ede6185-83'/>
Nov 27 03:23:57 user nova-compute[75006]:       <model type='virtio'/>
Nov 27 03:23:57 user nova-compute[75006]:       <mtu size='1442'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='net0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </interface>
Nov 27 03:23:57 user nova-compute[75006]:     <serial type='pty'>
Nov 27 03:23:57 user nova-compute[75006]:       <source path='/dev/pts/9'/>
Nov 27 03:23:57 user nova-compute[75006]:       <log file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log' append='off'/>
Nov 27 03:23:57 user nova-compute[75006]:       <target type='isa-serial' port='0'>
Nov 27 03:23:57 user nova-compute[75006]:         <model name='isa-serial'/>
Nov 27 03:23:57 user nova-compute[75006]:       </target>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='serial0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </serial>
Nov 27 03:23:57 user nova-compute[75006]:     <console type='pty' tty='/dev/pts/9'>
Nov 27 03:23:57 user nova-compute[75006]:       <source path='/dev/pts/9'/>
Nov 27 03:23:57 user nova-compute[75006]:       <log file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log' append='off'/>
Nov 27 03:23:57 user nova-compute[75006]:       <target type='serial' port='0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='serial0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </console>
Nov 27 03:23:57 user nova-compute[75006]:     <input type='mouse' bus='ps2'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='input0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </input>
Nov 27 03:23:57 user nova-compute[75006]:     <input type='keyboard' bus='ps2'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='input1'/>
Nov 27 03:23:57 user nova-compute[75006]:     </input>
Nov 27 03:23:57 user nova-compute[75006]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 27 03:23:57 user nova-compute[75006]:       <listen type='address' address='0.0.0.0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </graphics>
Nov 27 03:23:57 user nova-compute[75006]:     <audio id='1' type='none'/>
Nov 27 03:23:57 user nova-compute[75006]:     <video>
Nov 27 03:23:57 user nova-compute[75006]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='video0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </video>
Nov 27 03:23:57 user nova-compute[75006]:     <memballoon model='virtio'>
Nov 27 03:23:57 user nova-compute[75006]:       <stats period='10'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='balloon0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </memballoon>
Nov 27 03:23:57 user nova-compute[75006]:     <rng model='virtio'>
Nov 27 03:23:57 user nova-compute[75006]:       <backend model='random'>/dev/urandom</backend>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='rng0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </rng>
Nov 27 03:23:57 user nova-compute[75006]:   </devices>
Nov 27 03:23:57 user nova-compute[75006]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 03:23:57 user nova-compute[75006]:     <label>libvirt-7b4d808c-beca-4008-8733-31afc9b26d80</label>
Nov 27 03:23:57 user nova-compute[75006]:     <imagelabel>libvirt-7b4d808c-beca-4008-8733-31afc9b26d80</imagelabel>
Nov 27 03:23:57 user nova-compute[75006]:   </seclabel>
Nov 27 03:23:57 user nova-compute[75006]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 03:23:57 user nova-compute[75006]:     <label>+64055:+108</label>
Nov 27 03:23:57 user nova-compute[75006]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 03:23:57 user nova-compute[75006]:   </seclabel>
Nov 27 03:23:57 user nova-compute[75006]: </domain>
Nov 27 03:23:57 user nova-compute[75006]:  {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface> {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f1:20:08"/><model type="virtio"/><mtu size="1442"/><target dev="tap252ba82d-08"/></interface>not found in domain: <domain type='kvm' id='16'>
Nov 27 03:23:57 user nova-compute[75006]:   <name>instance-0000000f</name>
Nov 27 03:23:57 user nova-compute[75006]:   <uuid>7b4d808c-beca-4008-8733-31afc9b26d80</uuid>
Nov 27 03:23:57 user nova-compute[75006]:   <metadata>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:23:57 user nova-compute[75006]:   <nova:package version="0.0.0"/>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:name>tempest-device-tagging-server-1358855801</nova:name>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:creationTime>2023-11-27 03:23:56</nova:creationTime>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:flavor name="m1.tiny">
Nov 27 03:23:57 user nova-compute[75006]:     <nova:memory>512</nova:memory>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:disk>1</nova:disk>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:swap>0</nova:swap>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:vcpus>1</nova:vcpus>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:flavor>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:owner>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:user uuid="8fe95d495e394f6094f76fa8a9bdf8a0">tempest-TaggedAttachmentsTest-2115441077-project-member</nova:user>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:project uuid="cec104eb22944c46a2ed69b13fc26eec">tempest-TaggedAttachmentsTest-2115441077</nova:project>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:owner>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:ports>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:port uuid="1ede6185-835b-45f8-a691-5d49116fdd90">
Nov 27 03:23:57 user nova-compute[75006]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:23:57 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:ports>
Nov 27 03:23:57 user nova-compute[75006]: </nova:instance>
Nov 27 03:23:57 user nova-compute[75006]:   </metadata>
Nov 27 03:23:57 user nova-compute[75006]:   <memory unit='KiB'>524288</memory>
Nov 27 03:23:57 user nova-compute[75006]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 03:23:57 user nova-compute[75006]:   <vcpu placement='static'>1</vcpu>
Nov 27 03:23:57 user nova-compute[75006]:   <resource>
Nov 27 03:23:57 user nova-compute[75006]:     <partition>/machine</partition>
Nov 27 03:23:57 user nova-compute[75006]:   </resource>
Nov 27 03:23:57 user nova-compute[75006]:   <sysinfo type='smbios'>
Nov 27 03:23:57 user nova-compute[75006]:     <system>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='version'>0.0.0</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='serial'>7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='uuid'>7b4d808c-beca-4008-8733-31afc9b26d80</entry>
Nov 27 03:23:57 user nova-compute[75006]:       <entry name='family'>Virtual Machine</entry>
Nov 27 03:23:57 user nova-compute[75006]:     </system>
Nov 27 03:23:57 user nova-compute[75006]:   </sysinfo>
Nov 27 03:23:57 user nova-compute[75006]:   <os>
Nov 27 03:23:57 user nova-compute[75006]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 03:23:57 user nova-compute[75006]:     <boot dev='hd'/>
Nov 27 03:23:57 user nova-compute[75006]:     <smbios mode='sysinfo'/>
Nov 27 03:23:57 user nova-compute[75006]:   </os>
Nov 27 03:23:57 user nova-compute[75006]:   <features>
Nov 27 03:23:57 user nova-compute[75006]:     <acpi/>
Nov 27 03:23:57 user nova-compute[75006]:     <apic/>
Nov 27 03:23:57 user nova-compute[75006]:     <vmcoreinfo state='on'/>
Nov 27 03:23:57 user nova-compute[75006]:   </features>
Nov 27 03:23:57 user nova-compute[75006]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 03:23:57 user nova-compute[75006]:     <model fallback='forbid'>Nehalem</model>
Nov 27 03:23:57 user nova-compute[75006]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 03:23:57 user nova-compute[75006]:     <feature policy='require' name='vme'/>
Nov 27 03:23:57 user nova-compute[75006]:     <feature policy='require' name='x2apic'/>
Nov 27 03:23:57 user nova-compute[75006]:     <feature policy='require' name='hypervisor'/>
Nov 27 03:23:57 user nova-compute[75006]:   </cpu>
Nov 27 03:23:57 user nova-compute[75006]:   <clock offset='utc'>
Nov 27 03:23:57 user nova-compute[75006]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 03:23:57 user nova-compute[75006]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 03:23:57 user nova-compute[75006]:     <timer name='hpet' present='no'/>
Nov 27 03:23:57 user nova-compute[75006]:   </clock>
Nov 27 03:23:57 user nova-compute[75006]:   <on_poweroff>destroy</on_poweroff>
Nov 27 03:23:57 user nova-compute[75006]:   <on_reboot>restart</on_reboot>
Nov 27 03:23:57 user nova-compute[75006]:   <on_crash>destroy</on_crash>
Nov 27 03:23:57 user nova-compute[75006]:   <devices>
Nov 27 03:23:57 user nova-compute[75006]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 03:23:57 user nova-compute[75006]:     <disk type='file' device='disk'>
Nov 27 03:23:57 user nova-compute[75006]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 03:23:57 user nova-compute[75006]:       <source file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk' index='2'/>
Nov 27 03:23:57 user nova-compute[75006]:       <backingStore type='file' index='3'>
Nov 27 03:23:57 user nova-compute[75006]:         <format type='raw'/>
Nov 27 03:23:57 user nova-compute[75006]:         <source file='/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe'/>
Nov 27 03:23:57 user nova-compute[75006]:         <backingStore/>
Nov 27 03:23:57 user nova-compute[75006]:       </backingStore>
Nov 27 03:23:57 user nova-compute[75006]:       <target dev='vda' bus='virtio'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='virtio-disk0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </disk>
Nov 27 03:23:57 user nova-compute[75006]:     <disk type='file' device='cdrom'>
Nov 27 03:23:57 user nova-compute[75006]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 03:23:57 user nova-compute[75006]:       <source file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/disk.config' index='1'/>
Nov 27 03:23:57 user nova-compute[75006]:       <backingStore/>
Nov 27 03:23:57 user nova-compute[75006]:       <target dev='hda' bus='ide'/>
Nov 27 03:23:57 user nova-compute[75006]:       <readonly/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='ide0-0-0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </disk>
Nov 27 03:23:57 user nova-compute[75006]:     <controller type='usb' index='0' model='none'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='usb'/>
Nov 27 03:23:57 user nova-compute[75006]:     </controller>
Nov 27 03:23:57 user nova-compute[75006]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='pci.0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </controller>
Nov 27 03:23:57 user nova-compute[75006]:     <controller type='ide' index='0'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='ide'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 03:23:57 user nova-compute[75006]:     </controller>
Nov 27 03:23:57 user nova-compute[75006]:     <interface type='ethernet'>
Nov 27 03:23:57 user nova-compute[75006]:       <mac address='fa:16:3e:72:63:dd'/>
Nov 27 03:23:57 user nova-compute[75006]:       <target dev='tap1ede6185-83'/>
Nov 27 03:23:57 user nova-compute[75006]:       <model type='virtio'/>
Nov 27 03:23:57 user nova-compute[75006]:       <mtu size='1442'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='net0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </interface>
Nov 27 03:23:57 user nova-compute[75006]:     <serial type='pty'>
Nov 27 03:23:57 user nova-compute[75006]:       <source path='/dev/pts/9'/>
Nov 27 03:23:57 user nova-compute[75006]:       <log file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log' append='off'/>
Nov 27 03:23:57 user nova-compute[75006]:       <target type='isa-serial' port='0'>
Nov 27 03:23:57 user nova-compute[75006]:         <model name='isa-serial'/>
Nov 27 03:23:57 user nova-compute[75006]:       </target>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='serial0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </serial>
Nov 27 03:23:57 user nova-compute[75006]:     <console type='pty' tty='/dev/pts/9'>
Nov 27 03:23:57 user nova-compute[75006]:       <source path='/dev/pts/9'/>
Nov 27 03:23:57 user nova-compute[75006]:       <log file='/opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80/console.log' append='off'/>
Nov 27 03:23:57 user nova-compute[75006]:       <target type='serial' port='0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='serial0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </console>
Nov 27 03:23:57 user nova-compute[75006]:     <input type='mouse' bus='ps2'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='input0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </input>
Nov 27 03:23:57 user nova-compute[75006]:     <input type='keyboard' bus='ps2'>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='input1'/>
Nov 27 03:23:57 user nova-compute[75006]:     </input>
Nov 27 03:23:57 user nova-compute[75006]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 27 03:23:57 user nova-compute[75006]:       <listen type='address' address='0.0.0.0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </graphics>
Nov 27 03:23:57 user nova-compute[75006]:     <audio id='1' type='none'/>
Nov 27 03:23:57 user nova-compute[75006]:     <video>
Nov 27 03:23:57 user nova-compute[75006]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='video0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </video>
Nov 27 03:23:57 user nova-compute[75006]:     <memballoon model='virtio'>
Nov 27 03:23:57 user nova-compute[75006]:       <stats period='10'/>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='balloon0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </memballoon>
Nov 27 03:23:57 user nova-compute[75006]:     <rng model='virtio'>
Nov 27 03:23:57 user nova-compute[75006]:       <backend model='random'>/dev/urandom</backend>
Nov 27 03:23:57 user nova-compute[75006]:       <alias name='rng0'/>
Nov 27 03:23:57 user nova-compute[75006]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 03:23:57 user nova-compute[75006]:     </rng>
Nov 27 03:23:57 user nova-compute[75006]:   </devices>
Nov 27 03:23:57 user nova-compute[75006]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 03:23:57 user nova-compute[75006]:     <label>libvirt-7b4d808c-beca-4008-8733-31afc9b26d80</label>
Nov 27 03:23:57 user nova-compute[75006]:     <imagelabel>libvirt-7b4d808c-beca-4008-8733-31afc9b26d80</imagelabel>
Nov 27 03:23:57 user nova-compute[75006]:   </seclabel>
Nov 27 03:23:57 user nova-compute[75006]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 03:23:57 user nova-compute[75006]:     <label>+64055:+108</label>
Nov 27 03:23:57 user nova-compute[75006]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 03:23:57 user nova-compute[75006]:   </seclabel>
Nov 27 03:23:57 user nova-compute[75006]: </domain>
Nov 27 03:23:57 user nova-compute[75006]:  {{(pid=75006) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 03:23:57 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Detaching interface fa:16:3e:f1:20:08 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap252ba82d-08' not found.
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.network.os_vif_util [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Converting VIF {"id": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "address": "fa:16:3e:f1:20:08", "network": {"id": "db0de507-0765-4a87-a1fd-43779416a29f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1181947563", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252ba82d-08", "ovs_interfaceid": "252ba82d-08ad-4ebe-add5-55dc9e5c20c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.network.os_vif_util [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG os_vif [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap252ba82d-08, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:23:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:23:57 user nova-compute[75006]: INFO os_vif [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:20:08,bridge_name='br-int',has_traffic_filtering=True,id=252ba82d-08ad-4ebe-add5-55dc9e5c20c2,network=Network(db0de507-0765-4a87-a1fd-43779416a29f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252ba82d-08')
Nov 27 03:23:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [req-cd7ec157-ee6c-4772-845e-fe6f87ccb657 req-9408ed19-b83b-4e1b-adbc-616626722a43 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:23:57 user nova-compute[75006]:   <nova:package version="0.0.0"/>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:name>tempest-device-tagging-server-1358855801</nova:name>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:creationTime>2023-11-27 03:23:57</nova:creationTime>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:flavor name="m1.tiny">
Nov 27 03:23:57 user nova-compute[75006]:     <nova:memory>512</nova:memory>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:disk>1</nova:disk>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:swap>0</nova:swap>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:vcpus>1</nova:vcpus>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:flavor>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:owner>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:user uuid="8fe95d495e394f6094f76fa8a9bdf8a0">tempest-TaggedAttachmentsTest-2115441077-project-member</nova:user>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:project uuid="cec104eb22944c46a2ed69b13fc26eec">tempest-TaggedAttachmentsTest-2115441077</nova:project>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:owner>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:23:57 user nova-compute[75006]:   <nova:ports>
Nov 27 03:23:57 user nova-compute[75006]:     <nova:port uuid="1ede6185-835b-45f8-a691-5d49116fdd90">
Nov 27 03:23:57 user nova-compute[75006]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:23:57 user nova-compute[75006]:     </nova:port>
Nov 27 03:23:57 user nova-compute[75006]:   </nova:ports>
Nov 27 03:23:57 user nova-compute[75006]: </nova:instance>
Nov 27 03:23:57 user nova-compute[75006]:  {{(pid=75006) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 03:23:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating instance_info_cache with network_info: [{"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Releasing lock "refresh_cache-7b4d808c-beca-4008-8733-31afc9b26d80" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-87e18fa6-02fc-4794-ae81-4a0f31990924 tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "interface-7b4d808c-beca-4008-8733-31afc9b26d80-252ba82d-08ad-4ebe-add5-55dc9e5c20c2" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.357s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:58 user nova-compute[75006]: INFO nova.compute.manager [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Rescuing
Nov 27 03:23:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:23:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquired lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:23:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updating instance_info_cache with network_info: [{"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Releasing lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-302b49d2-ce86-48b6-882b-1ef555804499 req-c04796bb-c7f7-4be2-a95f-5d769eefe8e7 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-unplugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-302b49d2-ce86-48b6-882b-1ef555804499 req-c04796bb-c7f7-4be2-a95f-5d769eefe8e7 service nova] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-302b49d2-ce86-48b6-882b-1ef555804499 req-c04796bb-c7f7-4be2-a95f-5d769eefe8e7 service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-302b49d2-ce86-48b6-882b-1ef555804499 req-c04796bb-c7f7-4be2-a95f-5d769eefe8e7 service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-302b49d2-ce86-48b6-882b-1ef555804499 req-c04796bb-c7f7-4be2-a95f-5d769eefe8e7 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] No waiting events found dispatching network-vif-unplugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:23:59 user nova-compute[75006]: WARNING nova.compute.manager [req-302b49d2-ce86-48b6-882b-1ef555804499 req-c04796bb-c7f7-4be2-a95f-5d769eefe8e7 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received unexpected event network-vif-unplugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 for instance with vm_state active and task_state rescuing.
Nov 27 03:23:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:23:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Instance destroyed successfully.
Nov 27 03:24:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Attempting rescue
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75006) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Instance directory exists: not creating {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 03:24:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Creating image(s)
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.instance [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'trusted_certs' on Instance uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue" returned: 0 in 0.063s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.instance [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'migration_context' on Instance uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.base [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<cb58f809-30cb-487b-b608-f2c7973d2225> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Start _get_guest_xml network_info=[{"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:0c:8a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.instance [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'resources' on Instance uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.base [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<cb58f809-30cb-487b-b608-f2c7973d2225> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.instance [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'numa_topology' on Instance uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.base [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<cb58f809-30cb-487b-b608-f2c7973d2225> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:24:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.instance [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.base [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<cb58f809-30cb-487b-b608-f2c7973d2225> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-25001566',display_name='tempest-ServerRescueNegativeTestJSON-server-25001566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-25001566',id=19,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-grd0zaz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:22:18Z,user_data=None,user_id='797a8975406044ddabaad6e23950a71b',uuid=cb58f809-30cb-487b-b608-f2c7973d2225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:0c:8a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:0c:8a:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:8a:a9,bridge_name='br-int',has_traffic_filtering=True,id=6fa4288a-6cba-4a47-b71c-0f07522e84e8,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa4288a-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.instance [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'pci_devices' on Instance uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.objects.base [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<cb58f809-30cb-487b-b608-f2c7973d2225> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:24:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:24:00 user nova-compute[75006]:   <uuid>cb58f809-30cb-487b-b608-f2c7973d2225</uuid>
Nov 27 03:24:00 user nova-compute[75006]:   <name>instance-00000013</name>
Nov 27 03:24:00 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:24:00 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:24:00 user nova-compute[75006]:   <metadata>
Nov 27 03:24:00 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:24:00 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:24:00 user nova-compute[75006]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-25001566</nova:name>
Nov 27 03:24:00 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:24:00</nova:creationTime>
Nov 27 03:24:00 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:24:00 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:24:00 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:24:00 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:24:00 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:24:00 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:24:00 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:24:00 user nova-compute[75006]:       <nova:owner>
Nov 27 03:24:00 user nova-compute[75006]:         <nova:user uuid="797a8975406044ddabaad6e23950a71b">tempest-ServerRescueNegativeTestJSON-599355303-project-member</nova:user>
Nov 27 03:24:00 user nova-compute[75006]:         <nova:project uuid="7b2d179ed36d41038da75b63b1bde170">tempest-ServerRescueNegativeTestJSON-599355303</nova:project>
Nov 27 03:24:00 user nova-compute[75006]:       </nova:owner>
Nov 27 03:24:00 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:24:00 user nova-compute[75006]:       <nova:ports>
Nov 27 03:24:00 user nova-compute[75006]:         <nova:port uuid="6fa4288a-6cba-4a47-b71c-0f07522e84e8">
Nov 27 03:24:00 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 03:24:00 user nova-compute[75006]:         </nova:port>
Nov 27 03:24:00 user nova-compute[75006]:       </nova:ports>
Nov 27 03:24:00 user nova-compute[75006]:     </nova:instance>
Nov 27 03:24:00 user nova-compute[75006]:   </metadata>
Nov 27 03:24:00 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:24:00 user nova-compute[75006]:     <system>
Nov 27 03:24:00 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:24:00 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:24:00 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:24:00 user nova-compute[75006]:       <entry name="serial">cb58f809-30cb-487b-b608-f2c7973d2225</entry>
Nov 27 03:24:00 user nova-compute[75006]:       <entry name="uuid">cb58f809-30cb-487b-b608-f2c7973d2225</entry>
Nov 27 03:24:00 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:24:00 user nova-compute[75006]:     </system>
Nov 27 03:24:00 user nova-compute[75006]:   </sysinfo>
Nov 27 03:24:00 user nova-compute[75006]:   <os>
Nov 27 03:24:00 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:24:00 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:24:00 user nova-compute[75006]:   </os>
Nov 27 03:24:00 user nova-compute[75006]:   <features>
Nov 27 03:24:00 user nova-compute[75006]:     <acpi/>
Nov 27 03:24:00 user nova-compute[75006]:     <apic/>
Nov 27 03:24:00 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:24:00 user nova-compute[75006]:   </features>
Nov 27 03:24:00 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:24:00 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:24:00 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:24:00 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:24:00 user nova-compute[75006]:   </clock>
Nov 27 03:24:00 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:24:00 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:24:00 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:24:00 user nova-compute[75006]:   </cpu>
Nov 27 03:24:00 user nova-compute[75006]:   <devices>
Nov 27 03:24:00 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:24:00 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:24:00 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue"/>
Nov 27 03:24:00 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:24:00 user nova-compute[75006]:     </disk>
Nov 27 03:24:00 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:24:00 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:24:00 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk"/>
Nov 27 03:24:00 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:24:00 user nova-compute[75006]:     </disk>
Nov 27 03:24:00 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:24:00 user nova-compute[75006]:       <mac address="fa:16:3e:0c:8a:a9"/>
Nov 27 03:24:00 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:24:00 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:24:00 user nova-compute[75006]:       <target dev="tap6fa4288a-6c"/>
Nov 27 03:24:00 user nova-compute[75006]:     </interface>
Nov 27 03:24:00 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:24:00 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/console.log" append="off"/>
Nov 27 03:24:00 user nova-compute[75006]:     </serial>
Nov 27 03:24:00 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:24:00 user nova-compute[75006]:     <video>
Nov 27 03:24:00 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:24:00 user nova-compute[75006]:     </video>
Nov 27 03:24:00 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:24:00 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:24:00 user nova-compute[75006]:     </rng>
Nov 27 03:24:00 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:24:00 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:24:00 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:24:00 user nova-compute[75006]:     </memballoon>
Nov 27 03:24:00 user nova-compute[75006]:   </devices>
Nov 27 03:24:00 user nova-compute[75006]: </domain>
Nov 27 03:24:00 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:24:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Instance destroyed successfully.
Nov 27 03:24:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No VIF found with MAC fa:16:3e:0c:8a:a9, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:01 user nova-compute[75006]: INFO nova.compute.manager [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Terminating instance
Nov 27 03:24:01 user nova-compute[75006]: DEBUG nova.compute.manager [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-21dc456b-2e22-4b74-a179-8db97414f9d1 req-da011dfd-b444-4464-84ab-93b10bf71a6b service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-21dc456b-2e22-4b74-a179-8db97414f9d1 req-da011dfd-b444-4464-84ab-93b10bf71a6b service nova] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-21dc456b-2e22-4b74-a179-8db97414f9d1 req-da011dfd-b444-4464-84ab-93b10bf71a6b service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-21dc456b-2e22-4b74-a179-8db97414f9d1 req-da011dfd-b444-4464-84ab-93b10bf71a6b service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-21dc456b-2e22-4b74-a179-8db97414f9d1 req-da011dfd-b444-4464-84ab-93b10bf71a6b service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] No waiting events found dispatching network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:02 user nova-compute[75006]: WARNING nova.compute.manager [req-21dc456b-2e22-4b74-a179-8db97414f9d1 req-da011dfd-b444-4464-84ab-93b10bf71a6b service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received unexpected event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 for instance with vm_state active and task_state rescuing.
Nov 27 03:24:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Instance destroyed successfully.
Nov 27 03:24:02 user nova-compute[75006]: DEBUG nova.objects.instance [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lazy-loading 'resources' on Instance uuid 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1887490501',display_name='tempest-VolumesAdminNegativeTest-server-1887490501',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1887490501',id=6,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlWJwS0YgOf7ZxOyzmv2cE4jjjnOwed68ctZbTmAkmzhm2wZBR2KJ+ohuYaYHMmb7nerMDgh1qfdvAMr3j0+nlns8j0ks/r1uvx18qUC8mCixy8IFoTKVY0dt0wc6gaRw==',key_name='tempest-keypair-424830851',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a358e4342c8a48ddb127bdaf5a9256a8',ramdisk_id='',reservation_id='r-lfvagg2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1662628799',owner_user_name='tempest-VolumesAdminNegativeTest-1662628799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:18:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f150fc08fad489aa036b747757792f1',uuid=51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converting VIF {"id": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "address": "fa:16:3e:05:6e:35", "network": {"id": "096e36c9-39ed-4373-8418-c6b51f4b0f3f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-827171652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a358e4342c8a48ddb127bdaf5a9256a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb38f54c-ae", "ovs_interfaceid": "db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:6e:35,bridge_name='br-int',has_traffic_filtering=True,id=db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb38f54c-ae') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG os_vif [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:6e:35,bridge_name='br-int',has_traffic_filtering=True,id=db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb38f54c-ae') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb38f54c-ae, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fecfbf3-f250-47e9-b81a-d745fd188877) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:02 user nova-compute[75006]: INFO os_vif [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:6e:35,bridge_name='br-int',has_traffic_filtering=True,id=db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1,network=Network(096e36c9-39ed-4373-8418-c6b51f4b0f3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb38f54c-ae')
Nov 27 03:24:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Deleting instance files /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7_del
Nov 27 03:24:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Deletion of /opt/stack/data/nova/instances/51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7_del complete
Nov 27 03:24:02 user nova-compute[75006]: INFO nova.compute.manager [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 27 03:24:02 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:24:02 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:24:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:03 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:03 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Took 0.79 seconds to deallocate network for instance.
Nov 27 03:24:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-b5749528-3f66-480a-9921-2b842adbca48 req-651a464f-82ed-4924-83e0-8932ec0375ba service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received event network-vif-deleted-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:03 user nova-compute[75006]: INFO nova.compute.manager [req-b5749528-3f66-480a-9921-2b842adbca48 req-651a464f-82ed-4924-83e0-8932ec0375ba service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Neutron deleted interface db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1; detaching it from the instance and deleting it from the info cache
Nov 27 03:24:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-b5749528-3f66-480a-9921-2b842adbca48 req-651a464f-82ed-4924-83e0-8932ec0375ba service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-b5749528-3f66-480a-9921-2b842adbca48 req-651a464f-82ed-4924-83e0-8932ec0375ba service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Detach interface failed, port_id=db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1, reason: Instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:24:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received event network-vif-unplugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] No waiting events found dispatching network-vif-unplugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:04 user nova-compute[75006]: WARNING nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received unexpected event network-vif-unplugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 for instance with vm_state deleted and task_state None.
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received event network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Acquiring lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] No waiting events found dispatching network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:04 user nova-compute[75006]: WARNING nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7] Received unexpected event network-vif-plugged-db38f54c-ae92-450f-a3c3-2b6e3ba6c0e1 for instance with vm_state deleted and task_state None.
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] No waiting events found dispatching network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:04 user nova-compute[75006]: WARNING nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received unexpected event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 for instance with vm_state active and task_state rescuing.
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] No waiting events found dispatching network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:04 user nova-compute[75006]: WARNING nova.compute.manager [req-9d1ca2ac-7903-4f7e-9876-5b5bc6a66a49 req-6d423ec0-23ae-4673-930f-1c0db255aba5 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received unexpected event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 for instance with vm_state active and task_state rescuing.
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:04 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Deleted allocations for instance 51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7
Nov 27 03:24:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-69365db3-aa4a-4a80-825e-b782d3e65062 tempest-VolumesAdminNegativeTest-1662628799 tempest-VolumesAdminNegativeTest-1662628799-project-member] Lock "51c72f41-4ce8-4bbb-bde9-55f71bf5c0d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.664s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-866c819c-e17b-41d1-ba2a-b6d2f730576c tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:24:05 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 is timed out.
Nov 27 03:24:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully detached device vdb from instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 from the live domain config.
Nov 27 03:24:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJYKSaHO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:24:05 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f377c39-3b45-455b-9918-e5ec11b6a89c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:24:05 user nova-compute[75006]: No targets found.
Nov 27 03:24:05 user nova-compute[75006]: iSNS:
Nov 27 03:24:05 user nova-compute[75006]: No targets found.
Nov 27 03:24:05 user nova-compute[75006]: STATIC:
Nov 27 03:24:05 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469
Nov 27 03:24:05 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:24:05 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:24:05 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231
Nov 27 03:24:05 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:24:05 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:24:05 user nova-compute[75006]: FIRMWARE:
Nov 27 03:24:05 user nova-compute[75006]: No targets found.
Nov 27 03:24:05 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:24:05 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:24:05 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca729d5-5151-4a69-8bce-14a0c985bb5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[989821df-1c33-4121-8c65-4ac9efb507ae]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:24:05 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:24:05 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:24:05 user nova-compute[75006]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 (non-flash)
Nov 27 03:24:05 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4482e3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed815f25-5e46-4797-a7a1-67e877e8fa20]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dba842-cb20-441d-b1d1-96fb5e12aba3]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[87795488-e5b3-4145-8083-21d3f62ff876]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5cd5e5-1061-4596-80b7-8062cc8d3f6b]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbca908-2cac-4e4f-a36f-f548d192f505]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a412327c-23d8-404a-b9a0-296ca25727a4]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260]
Nov 27 03:24:05 user nova-compute[75006]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231, portal: 172.16.0.220,3260] successful.
Nov 27 03:24:05 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2500f817-c1b9-4704-b404-22a17c6a0231 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0e2302-df1b-410d-883b-92410e7ca7d8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== disconnect_volume: return (303ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:24:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:24:06 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0da4a49e-d5c9-4825-99bc-1e353c2eb1c1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.844s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-de52e0c5-41dc-4c92-b3ad-debaef8445b5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-de52e0c5-41dc-4c92-b3ad-debaef8445b5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-de52e0c5-41dc-4c92-b3ad-debaef8445b5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-de52e0c5-41dc-4c92-b3ad-debaef8445b5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75006) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG nova.objects.instance [None req-de52e0c5-41dc-4c92-b3ad-debaef8445b5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG nova.compute.manager [req-819ff19c-6235-45a8-ac9a-b25b2e4102e0 req-473fe18a-4558-451c-8907-6e61a17e0a2a service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-819ff19c-6235-45a8-ac9a-b25b2e4102e0 req-473fe18a-4558-451c-8907-6e61a17e0a2a service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-819ff19c-6235-45a8-ac9a-b25b2e4102e0 req-473fe18a-4558-451c-8907-6e61a17e0a2a service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-819ff19c-6235-45a8-ac9a-b25b2e4102e0 req-473fe18a-4558-451c-8907-6e61a17e0a2a service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:07 user nova-compute[75006]: DEBUG nova.compute.manager [req-819ff19c-6235-45a8-ac9a-b25b2e4102e0 req-473fe18a-4558-451c-8907-6e61a17e0a2a service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:07 user nova-compute[75006]: WARNING nova.compute.manager [req-819ff19c-6235-45a8-ac9a-b25b2e4102e0 req-473fe18a-4558-451c-8907-6e61a17e0a2a service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state active and task_state powering-off.
Nov 27 03:24:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance destroyed successfully.
Nov 27 03:24:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-de52e0c5-41dc-4c92-b3ad-debaef8445b5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:24:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-de52e0c5-41dc-4c92-b3ad-debaef8445b5 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.926s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid fd992ae2-0b97-47d2-9e03-f707af65f190 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "fd992ae2-0b97-47d2-9e03-f707af65f190" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "cb58f809-30cb-487b-b608-f2c7973d2225" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "cb58f809-30cb-487b-b608-f2c7973d2225" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-ca115639-7d44-4637-8303-2f045da6c280 req-d8cf0c39-382e-46ca-902b-acdcd2d4e2f0 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ca115639-7d44-4637-8303-2f045da6c280 req-d8cf0c39-382e-46ca-902b-acdcd2d4e2f0 service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ca115639-7d44-4637-8303-2f045da6c280 req-d8cf0c39-382e-46ca-902b-acdcd2d4e2f0 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ca115639-7d44-4637-8303-2f045da6c280 req-d8cf0c39-382e-46ca-902b-acdcd2d4e2f0 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-ca115639-7d44-4637-8303-2f045da6c280 req-d8cf0c39-382e-46ca-902b-acdcd2d4e2f0 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:09 user nova-compute[75006]: WARNING nova.compute.manager [req-ca115639-7d44-4637-8303-2f045da6c280 req-d8cf0c39-382e-46ca-902b-acdcd2d4e2f0 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state stopped and task_state None.
Nov 27 03:24:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:17 user nova-compute[75006]: INFO nova.compute.manager [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Detaching volume f0ba20c6-f7b4-4313-bd00-ebcf3293b469
Nov 27 03:24:17 user nova-compute[75006]: INFO nova.virt.block_device [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Attempting to driver detach volume f0ba20c6-f7b4-4313-bd00-ebcf3293b469 from mountpoint /dev/vdb
Nov 27 03:24:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Attempting to detach device vdb from instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:24:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:24:17 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:24:17 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:24:17 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:24:17 user nova-compute[75006]:   <serial>f0ba20c6-f7b4-4313-bd00-ebcf3293b469</serial>
Nov 27 03:24:17 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:24:17 user nova-compute[75006]: </disk>
Nov 27 03:24:17 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:24:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Successfully detached device vdb from instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e from the persistent domain config.
Nov 27 03:24:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:24:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:24:17 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:24:17 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:24:17 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:24:17 user nova-compute[75006]:   <serial>f0ba20c6-f7b4-4313-bd00-ebcf3293b469</serial>
Nov 27 03:24:17 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:24:17 user nova-compute[75006]: </disk>
Nov 27 03:24:17 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:24:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:24:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:27 user nova-compute[75006]: INFO nova.compute.manager [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Terminating instance
Nov 27 03:24:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG nova.compute.manager [req-8e647640-f596-4ce5-9d26-17901d30fd49 req-6d7c9e4f-bd50-4e2d-a914-778cb29e10fe service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-unplugged-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8e647640-f596-4ce5-9d26-17901d30fd49 req-6d7c9e4f-bd50-4e2d-a914-778cb29e10fe service nova] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8e647640-f596-4ce5-9d26-17901d30fd49 req-6d7c9e4f-bd50-4e2d-a914-778cb29e10fe service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8e647640-f596-4ce5-9d26-17901d30fd49 req-6d7c9e4f-bd50-4e2d-a914-778cb29e10fe service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG nova.compute.manager [req-8e647640-f596-4ce5-9d26-17901d30fd49 req-6d7c9e4f-bd50-4e2d-a914-778cb29e10fe service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] No waiting events found dispatching network-vif-unplugged-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG nova.compute.manager [req-8e647640-f596-4ce5-9d26-17901d30fd49 req-6d7c9e4f-bd50-4e2d-a914-778cb29e10fe service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-unplugged-1ede6185-835b-45f8-a691-5d49116fdd90 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:24:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:28 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Instance destroyed successfully.
Nov 27 03:24:28 user nova-compute[75006]: DEBUG nova.objects.instance [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lazy-loading 'resources' on Instance uuid 7b4d808c-beca-4008-8733-31afc9b26d80 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:21:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1358855801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1358855801',id=15,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSsxKXSHoshY8deFc4Ir+FzMAFD+wjeglPDTNNHlsA1990fUiuiWfHICFDC7TB20ijRCo52Pf4ITNeishzEiDQmp3fp0zM/uyV7/YRlGT/tMucONMtlwuvbWu0gIwybDQ==',key_name='tempest-keypair-2144134962',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cec104eb22944c46a2ed69b13fc26eec',ramdisk_id='',reservation_id='r-nvzflxd6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2115441077',owner_user_name='tempest-TaggedAttachmentsTest-2115441077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fe95d495e394f6094f76fa8a9bdf8a0',uuid=7b4d808c-beca-4008-8733-31afc9b26d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converting VIF {"id": "1ede6185-835b-45f8-a691-5d49116fdd90", "address": "fa:16:3e:72:63:dd", "network": {"id": "7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-514443613-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cec104eb22944c46a2ed69b13fc26eec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ede6185-83", "ovs_interfaceid": "1ede6185-835b-45f8-a691-5d49116fdd90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=1ede6185-835b-45f8-a691-5d49116fdd90,network=Network(7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ede6185-83') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG os_vif [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=1ede6185-835b-45f8-a691-5d49116fdd90,network=Network(7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ede6185-83') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ede6185-83, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bb56a2c-cdf5-4f44-bff3-827993c1d2cd) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:28 user nova-compute[75006]: INFO os_vif [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:63:dd,bridge_name='br-int',has_traffic_filtering=True,id=1ede6185-835b-45f8-a691-5d49116fdd90,network=Network(7c1fb3ee-bf13-4ffb-b0e3-c9ac1c22e509),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ede6185-83')
Nov 27 03:24:28 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Deleting instance files /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80_del
Nov 27 03:24:28 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Deletion of /opt/stack/data/nova/instances/7b4d808c-beca-4008-8733-31afc9b26d80_del complete
Nov 27 03:24:28 user nova-compute[75006]: INFO nova.compute.manager [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 03:24:28 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:24:28 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:29 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Took 1.29 seconds to deallocate network for instance.
Nov 27 03:24:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-e2da6992-1e6c-45da-9014-a836769bf91c req-fab84f73-89df-4c6d-a5b9-760ac58d730e service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2da6992-1e6c-45da-9014-a836769bf91c req-fab84f73-89df-4c6d-a5b9-760ac58d730e service nova] Acquiring lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2da6992-1e6c-45da-9014-a836769bf91c req-fab84f73-89df-4c6d-a5b9-760ac58d730e service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2da6992-1e6c-45da-9014-a836769bf91c req-fab84f73-89df-4c6d-a5b9-760ac58d730e service nova] Lock "7b4d808c-beca-4008-8733-31afc9b26d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-e2da6992-1e6c-45da-9014-a836769bf91c req-fab84f73-89df-4c6d-a5b9-760ac58d730e service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] No waiting events found dispatching network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:29 user nova-compute[75006]: WARNING nova.compute.manager [req-e2da6992-1e6c-45da-9014-a836769bf91c req-fab84f73-89df-4c6d-a5b9-760ac58d730e service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received unexpected event network-vif-plugged-1ede6185-835b-45f8-a691-5d49116fdd90 for instance with vm_state deleted and task_state None.
Nov 27 03:24:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-e2da6992-1e6c-45da-9014-a836769bf91c req-fab84f73-89df-4c6d-a5b9-760ac58d730e service nova] [instance: 7b4d808c-beca-4008-8733-31afc9b26d80] Received event network-vif-deleted-1ede6185-835b-45f8-a691-5d49116fdd90 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:24:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:30 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Deleted allocations for instance 7b4d808c-beca-4008-8733-31afc9b26d80
Nov 27 03:24:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-035d7ea6-b4a0-4363-89ae-36dba37f9dea tempest-TaggedAttachmentsTest-2115441077 tempest-TaggedAttachmentsTest-2115441077-project-member] Lock "7b4d808c-beca-4008-8733-31afc9b26d80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.731s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:30 user nova-compute[75006]: DEBUG nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:24:31 user nova-compute[75006]: INFO nova.compute.claims [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Claim successful on node user
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.network.neutron [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:24:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.policy [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b50c3d4e86ae40fbb9f38f2a88066a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada4ca9c11a4996ad5f00f6beac2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:24:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Creating image(s)
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "/opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "/opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk 1073741824" returned: 0 in 0.066s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.network.neutron [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Successfully created port: 211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.218s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Cannot resize image /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Ensure instance console log exists: /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.network.neutron [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Successfully updated port: 211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquired lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.network.neutron [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-c71edc18-a637-48cc-9467-f55d9f349963 req-ecfb5b41-c8a7-43b0-a498-9e81c07825e3 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received event network-changed-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-c71edc18-a637-48cc-9467-f55d9f349963 req-ecfb5b41-c8a7-43b0-a498-9e81c07825e3 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Refreshing instance network info cache due to event network-changed-211dc942-48f1-40b2-8deb-99e87eaee687. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c71edc18-a637-48cc-9467-f55d9f349963 req-ecfb5b41-c8a7-43b0-a498-9e81c07825e3 service nova] Acquiring lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:24:32 user nova-compute[75006]: DEBUG nova.network.neutron [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.neutron [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Updating instance_info_cache with network_info: [{"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Releasing lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Instance network_info: |[{"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c71edc18-a637-48cc-9467-f55d9f349963 req-ecfb5b41-c8a7-43b0-a498-9e81c07825e3 service nova] Acquired lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.neutron [req-c71edc18-a637-48cc-9467-f55d9f349963 req-ecfb5b41-c8a7-43b0-a498-9e81c07825e3 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Refreshing network info cache for port 211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Start _get_guest_xml network_info=[{"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:24:33 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:33 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1940306102',display_name='tempest-VolumesSnapshotTestJSON-instance-1940306102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1940306102',id=21,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh2Fl7phxPL1LZUqmTP4aNcFaAtpJtTb4OWEfMk0oQ+mjVDoQX2n/8TtK7wY0ZSBn0cnFoTzaTQjmms93tS8atT50FlZdTGIvd/W3BYXCZcz9GdroRoFKCscxIaKN7DOg==',key_name='tempest-keypair-1522167447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ada4ca9c11a4996ad5f00f6beac2398',ramdisk_id='',reservation_id='r-m4306fz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-59016333',owner_user_name='tempest-VolumesSnapshotTestJSON-59016333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:24:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b50c3d4e86ae40fbb9f38f2a88066a03',uuid=b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converting VIF {"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=211dc942-48f1-40b2-8deb-99e87eaee687,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211dc942-48') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'pci_devices' on Instance uuid b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:24:33 user nova-compute[75006]:   <uuid>b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663</uuid>
Nov 27 03:24:33 user nova-compute[75006]:   <name>instance-00000015</name>
Nov 27 03:24:33 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:24:33 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:24:33 user nova-compute[75006]:   <metadata>
Nov 27 03:24:33 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:24:33 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:24:33 user nova-compute[75006]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1940306102</nova:name>
Nov 27 03:24:33 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:24:33</nova:creationTime>
Nov 27 03:24:33 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:24:33 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:24:33 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:24:33 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:24:33 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:24:33 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:24:33 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:24:33 user nova-compute[75006]:       <nova:owner>
Nov 27 03:24:33 user nova-compute[75006]:         <nova:user uuid="b50c3d4e86ae40fbb9f38f2a88066a03">tempest-VolumesSnapshotTestJSON-59016333-project-member</nova:user>
Nov 27 03:24:33 user nova-compute[75006]:         <nova:project uuid="6ada4ca9c11a4996ad5f00f6beac2398">tempest-VolumesSnapshotTestJSON-59016333</nova:project>
Nov 27 03:24:33 user nova-compute[75006]:       </nova:owner>
Nov 27 03:24:33 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:24:33 user nova-compute[75006]:       <nova:ports>
Nov 27 03:24:33 user nova-compute[75006]:         <nova:port uuid="211dc942-48f1-40b2-8deb-99e87eaee687">
Nov 27 03:24:33 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 03:24:33 user nova-compute[75006]:         </nova:port>
Nov 27 03:24:33 user nova-compute[75006]:       </nova:ports>
Nov 27 03:24:33 user nova-compute[75006]:     </nova:instance>
Nov 27 03:24:33 user nova-compute[75006]:   </metadata>
Nov 27 03:24:33 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:24:33 user nova-compute[75006]:     <system>
Nov 27 03:24:33 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:24:33 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:24:33 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:24:33 user nova-compute[75006]:       <entry name="serial">b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663</entry>
Nov 27 03:24:33 user nova-compute[75006]:       <entry name="uuid">b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663</entry>
Nov 27 03:24:33 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:24:33 user nova-compute[75006]:     </system>
Nov 27 03:24:33 user nova-compute[75006]:   </sysinfo>
Nov 27 03:24:33 user nova-compute[75006]:   <os>
Nov 27 03:24:33 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:24:33 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:24:33 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:24:33 user nova-compute[75006]:   </os>
Nov 27 03:24:33 user nova-compute[75006]:   <features>
Nov 27 03:24:33 user nova-compute[75006]:     <acpi/>
Nov 27 03:24:33 user nova-compute[75006]:     <apic/>
Nov 27 03:24:33 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:24:33 user nova-compute[75006]:   </features>
Nov 27 03:24:33 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:24:33 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:24:33 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:24:33 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:24:33 user nova-compute[75006]:   </clock>
Nov 27 03:24:33 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:24:33 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:24:33 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:24:33 user nova-compute[75006]:   </cpu>
Nov 27 03:24:33 user nova-compute[75006]:   <devices>
Nov 27 03:24:33 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:24:33 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:24:33 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk"/>
Nov 27 03:24:33 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:24:33 user nova-compute[75006]:     </disk>
Nov 27 03:24:33 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:24:33 user nova-compute[75006]:       <mac address="fa:16:3e:3b:fd:19"/>
Nov 27 03:24:33 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:24:33 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:24:33 user nova-compute[75006]:       <target dev="tap211dc942-48"/>
Nov 27 03:24:33 user nova-compute[75006]:     </interface>
Nov 27 03:24:33 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:24:33 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/console.log" append="off"/>
Nov 27 03:24:33 user nova-compute[75006]:     </serial>
Nov 27 03:24:33 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:24:33 user nova-compute[75006]:     <video>
Nov 27 03:24:33 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:24:33 user nova-compute[75006]:     </video>
Nov 27 03:24:33 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:24:33 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:24:33 user nova-compute[75006]:     </rng>
Nov 27 03:24:33 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:24:33 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:24:33 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:24:33 user nova-compute[75006]:     </memballoon>
Nov 27 03:24:33 user nova-compute[75006]:   </devices>
Nov 27 03:24:33 user nova-compute[75006]: </domain>
Nov 27 03:24:33 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1940306102',display_name='tempest-VolumesSnapshotTestJSON-instance-1940306102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1940306102',id=21,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh2Fl7phxPL1LZUqmTP4aNcFaAtpJtTb4OWEfMk0oQ+mjVDoQX2n/8TtK7wY0ZSBn0cnFoTzaTQjmms93tS8atT50FlZdTGIvd/W3BYXCZcz9GdroRoFKCscxIaKN7DOg==',key_name='tempest-keypair-1522167447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ada4ca9c11a4996ad5f00f6beac2398',ramdisk_id='',reservation_id='r-m4306fz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-59016333',owner_user_name='tempest-VolumesSnapshotTestJSON-59016333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:24:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b50c3d4e86ae40fbb9f38f2a88066a03',uuid=b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converting VIF {"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=211dc942-48f1-40b2-8deb-99e87eaee687,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211dc942-48') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG os_vif [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=211dc942-48f1-40b2-8deb-99e87eaee687,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211dc942-48') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f811f42-6636-554a-af05-d26ee5298e21', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap211dc942-48, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap211dc942-48, col_values=(('qos', UUID('424b7322-45d8-4fc1-b44d-86703c026b00')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap211dc942-48, col_values=(('external_ids', {'iface-id': '211dc942-48f1-40b2-8deb-99e87eaee687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:fd:19', 'vm-uuid': 'b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:24:33 user nova-compute[75006]: INFO nova.compute.claims [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Claim successful on node user
Nov 27 03:24:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:33 user nova-compute[75006]: INFO os_vif [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=211dc942-48f1-40b2-8deb-99e87eaee687,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211dc942-48')
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No VIF found with MAC fa:16:3e:3b:fd:19, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.neutron [req-c71edc18-a637-48cc-9467-f55d9f349963 req-ecfb5b41-c8a7-43b0-a498-9e81c07825e3 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Updated VIF entry in instance network info cache for port 211dc942-48f1-40b2-8deb-99e87eaee687. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.neutron [req-c71edc18-a637-48cc-9467-f55d9f349963 req-ecfb5b41-c8a7-43b0-a498-9e81c07825e3 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Updating instance_info_cache with network_info: [{"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c71edc18-a637-48cc-9467-f55d9f349963 req-ecfb5b41-c8a7-43b0-a498-9e81c07825e3 service nova] Releasing lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:24:33 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:24:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:24:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG nova.policy [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1836d0da810f4525addd0b02ae57c617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30af4989ad4414083de0576cf4dbd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:24:34 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Creating image(s)
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "/opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "/opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "/opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk 1073741824" returned: 0 in 0.064s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Successfully created port: aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.230s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Cannot resize image /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Ensure instance console log exists: /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ecb9816-e58b-4b69-bf1e-4eda0382f2dd req-67942ae7-65c1-4e13-b6e2-9af100f2b805 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received event network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ecb9816-e58b-4b69-bf1e-4eda0382f2dd req-67942ae7-65c1-4e13-b6e2-9af100f2b805 service nova] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ecb9816-e58b-4b69-bf1e-4eda0382f2dd req-67942ae7-65c1-4e13-b6e2-9af100f2b805 service nova] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ecb9816-e58b-4b69-bf1e-4eda0382f2dd req-67942ae7-65c1-4e13-b6e2-9af100f2b805 service nova] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ecb9816-e58b-4b69-bf1e-4eda0382f2dd req-67942ae7-65c1-4e13-b6e2-9af100f2b805 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] No waiting events found dispatching network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:35 user nova-compute[75006]: WARNING nova.compute.manager [req-7ecb9816-e58b-4b69-bf1e-4eda0382f2dd req-67942ae7-65c1-4e13-b6e2-9af100f2b805 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received unexpected event network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 for instance with vm_state building and task_state spawning.
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Successfully updated port: aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquired lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-0215b1d1-f700-489f-adaf-e26b93f081e7 req-6b90b610-9eaf-434b-83df-7a878498af34 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received event network-changed-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-0215b1d1-f700-489f-adaf-e26b93f081e7 req-6b90b610-9eaf-434b-83df-7a878498af34 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Refreshing instance network info cache due to event network-changed-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0215b1d1-f700-489f-adaf-e26b93f081e7 req-6b90b610-9eaf-434b-83df-7a878498af34 service nova] Acquiring lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:24:35 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Updating instance_info_cache with network_info: [{"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Releasing lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Instance network_info: |[{"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0215b1d1-f700-489f-adaf-e26b93f081e7 req-6b90b610-9eaf-434b-83df-7a878498af34 service nova] Acquired lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.network.neutron [req-0215b1d1-f700-489f-adaf-e26b93f081e7 req-6b90b610-9eaf-434b-83df-7a878498af34 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Refreshing network info cache for port aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Start _get_guest_xml network_info=[{"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:24:36 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:36 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-428956732',display_name='tempest-AttachVolumeNegativeTest-server-428956732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-428956732',id=22,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxInvwi2ZIWx5YeU+NVkLy9NftFN6c/+WzWH5G82JbMkyuqM5WXSicOvUHSnqm9jLPi8C2edPV14/ZxqqUQu+mNIhovKcanFpzdYsDqVaR1fsJI7iP8gbhmNAXTT6ansQ==',key_name='tempest-keypair-1602117111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-zdvh5yoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=b90e98c7-3949-4b69-80c7-2a5b85bc88a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:82:0a,bridge_name='br-int',has_traffic_filtering=True,id=aaa662b2-e109-4a0a-9d8d-2d6e2734dfec,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa662b2-e1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'pci_devices' on Instance uuid b90e98c7-3949-4b69-80c7-2a5b85bc88a3 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:24:36 user nova-compute[75006]:   <uuid>b90e98c7-3949-4b69-80c7-2a5b85bc88a3</uuid>
Nov 27 03:24:36 user nova-compute[75006]:   <name>instance-00000016</name>
Nov 27 03:24:36 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:24:36 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:24:36 user nova-compute[75006]:   <metadata>
Nov 27 03:24:36 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:24:36 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:24:36 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeNegativeTest-server-428956732</nova:name>
Nov 27 03:24:36 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:24:36</nova:creationTime>
Nov 27 03:24:36 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:24:36 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:24:36 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:24:36 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:24:36 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:24:36 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:24:36 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:24:36 user nova-compute[75006]:       <nova:owner>
Nov 27 03:24:36 user nova-compute[75006]:         <nova:user uuid="1836d0da810f4525addd0b02ae57c617">tempest-AttachVolumeNegativeTest-66969864-project-member</nova:user>
Nov 27 03:24:36 user nova-compute[75006]:         <nova:project uuid="f30af4989ad4414083de0576cf4dbd48">tempest-AttachVolumeNegativeTest-66969864</nova:project>
Nov 27 03:24:36 user nova-compute[75006]:       </nova:owner>
Nov 27 03:24:36 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:24:36 user nova-compute[75006]:       <nova:ports>
Nov 27 03:24:36 user nova-compute[75006]:         <nova:port uuid="aaa662b2-e109-4a0a-9d8d-2d6e2734dfec">
Nov 27 03:24:36 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 03:24:36 user nova-compute[75006]:         </nova:port>
Nov 27 03:24:36 user nova-compute[75006]:       </nova:ports>
Nov 27 03:24:36 user nova-compute[75006]:     </nova:instance>
Nov 27 03:24:36 user nova-compute[75006]:   </metadata>
Nov 27 03:24:36 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:24:36 user nova-compute[75006]:     <system>
Nov 27 03:24:36 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:24:36 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:24:36 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:24:36 user nova-compute[75006]:       <entry name="serial">b90e98c7-3949-4b69-80c7-2a5b85bc88a3</entry>
Nov 27 03:24:36 user nova-compute[75006]:       <entry name="uuid">b90e98c7-3949-4b69-80c7-2a5b85bc88a3</entry>
Nov 27 03:24:36 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:24:36 user nova-compute[75006]:     </system>
Nov 27 03:24:36 user nova-compute[75006]:   </sysinfo>
Nov 27 03:24:36 user nova-compute[75006]:   <os>
Nov 27 03:24:36 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:24:36 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:24:36 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:24:36 user nova-compute[75006]:   </os>
Nov 27 03:24:36 user nova-compute[75006]:   <features>
Nov 27 03:24:36 user nova-compute[75006]:     <acpi/>
Nov 27 03:24:36 user nova-compute[75006]:     <apic/>
Nov 27 03:24:36 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:24:36 user nova-compute[75006]:   </features>
Nov 27 03:24:36 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:24:36 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:24:36 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:24:36 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:24:36 user nova-compute[75006]:   </clock>
Nov 27 03:24:36 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:24:36 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:24:36 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:24:36 user nova-compute[75006]:   </cpu>
Nov 27 03:24:36 user nova-compute[75006]:   <devices>
Nov 27 03:24:36 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:24:36 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:24:36 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk"/>
Nov 27 03:24:36 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:24:36 user nova-compute[75006]:     </disk>
Nov 27 03:24:36 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:24:36 user nova-compute[75006]:       <mac address="fa:16:3e:4f:82:0a"/>
Nov 27 03:24:36 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:24:36 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:24:36 user nova-compute[75006]:       <target dev="tapaaa662b2-e1"/>
Nov 27 03:24:36 user nova-compute[75006]:     </interface>
Nov 27 03:24:36 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:24:36 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/console.log" append="off"/>
Nov 27 03:24:36 user nova-compute[75006]:     </serial>
Nov 27 03:24:36 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:24:36 user nova-compute[75006]:     <video>
Nov 27 03:24:36 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:24:36 user nova-compute[75006]:     </video>
Nov 27 03:24:36 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:24:36 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:24:36 user nova-compute[75006]:     </rng>
Nov 27 03:24:36 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:24:36 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:24:36 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:24:36 user nova-compute[75006]:     </memballoon>
Nov 27 03:24:36 user nova-compute[75006]:   </devices>
Nov 27 03:24:36 user nova-compute[75006]: </domain>
Nov 27 03:24:36 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-428956732',display_name='tempest-AttachVolumeNegativeTest-server-428956732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-428956732',id=22,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxInvwi2ZIWx5YeU+NVkLy9NftFN6c/+WzWH5G82JbMkyuqM5WXSicOvUHSnqm9jLPi8C2edPV14/ZxqqUQu+mNIhovKcanFpzdYsDqVaR1fsJI7iP8gbhmNAXTT6ansQ==',key_name='tempest-keypair-1602117111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-zdvh5yoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=b90e98c7-3949-4b69-80c7-2a5b85bc88a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:82:0a,bridge_name='br-int',has_traffic_filtering=True,id=aaa662b2-e109-4a0a-9d8d-2d6e2734dfec,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa662b2-e1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG os_vif [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:82:0a,bridge_name='br-int',has_traffic_filtering=True,id=aaa662b2-e109-4a0a-9d8d-2d6e2734dfec,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa662b2-e1') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd866a085-3294-56b1-9a21-7125a96a6876', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaa662b2-e1, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaaa662b2-e1, col_values=(('qos', UUID('54d42a53-ec68-40cd-b9b3-e4a270587002')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaaa662b2-e1, col_values=(('external_ids', {'iface-id': 'aaa662b2-e109-4a0a-9d8d-2d6e2734dfec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:82:0a', 'vm-uuid': 'b90e98c7-3949-4b69-80c7-2a5b85bc88a3'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:36 user nova-compute[75006]: INFO os_vif [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:82:0a,bridge_name='br-int',has_traffic_filtering=True,id=aaa662b2-e109-4a0a-9d8d-2d6e2734dfec,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa662b2-e1')
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No VIF found with MAC fa:16:3e:4f:82:0a, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.network.neutron [req-0215b1d1-f700-489f-adaf-e26b93f081e7 req-6b90b610-9eaf-434b-83df-7a878498af34 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Updated VIF entry in instance network info cache for port aaa662b2-e109-4a0a-9d8d-2d6e2734dfec. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG nova.network.neutron [req-0215b1d1-f700-489f-adaf-e26b93f081e7 req-6b90b610-9eaf-434b-83df-7a878498af34 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Updating instance_info_cache with network_info: [{"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0215b1d1-f700-489f-adaf-e26b93f081e7 req-6b90b610-9eaf-434b-83df-7a878498af34 service nova] Releasing lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-be607891-fd34-497e-bd0e-9989e28b532c req-d0c391b6-5065-476c-8e7f-09e1ab6732ca service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received event network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be607891-fd34-497e-bd0e-9989e28b532c req-d0c391b6-5065-476c-8e7f-09e1ab6732ca service nova] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be607891-fd34-497e-bd0e-9989e28b532c req-d0c391b6-5065-476c-8e7f-09e1ab6732ca service nova] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be607891-fd34-497e-bd0e-9989e28b532c req-d0c391b6-5065-476c-8e7f-09e1ab6732ca service nova] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-be607891-fd34-497e-bd0e-9989e28b532c req-d0c391b6-5065-476c-8e7f-09e1ab6732ca service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] No waiting events found dispatching network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:37 user nova-compute[75006]: WARNING nova.compute.manager [req-be607891-fd34-497e-bd0e-9989e28b532c req-d0c391b6-5065-476c-8e7f-09e1ab6732ca service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received unexpected event network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 for instance with vm_state building and task_state spawning.
Nov 27 03:24:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Instance spawned successfully.
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:37 user nova-compute[75006]: INFO nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:24:37 user nova-compute[75006]: INFO nova.compute.manager [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Took 6.46 seconds to build instance.
Nov 27 03:24:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-efb385bd-ae56-4467-a013-1a9e6f888bfb tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.668s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-33f0e2f7-429f-48f6-ab45-b68d7272e8bd req-802b6cba-d3b8-4f82-8c0f-1799f2815040 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received event network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-33f0e2f7-429f-48f6-ab45-b68d7272e8bd req-802b6cba-d3b8-4f82-8c0f-1799f2815040 service nova] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-33f0e2f7-429f-48f6-ab45-b68d7272e8bd req-802b6cba-d3b8-4f82-8c0f-1799f2815040 service nova] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-33f0e2f7-429f-48f6-ab45-b68d7272e8bd req-802b6cba-d3b8-4f82-8c0f-1799f2815040 service nova] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-33f0e2f7-429f-48f6-ab45-b68d7272e8bd req-802b6cba-d3b8-4f82-8c0f-1799f2815040 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] No waiting events found dispatching network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:37 user nova-compute[75006]: WARNING nova.compute.manager [req-33f0e2f7-429f-48f6-ab45-b68d7272e8bd req-802b6cba-d3b8-4f82-8c0f-1799f2815040 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received unexpected event network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec for instance with vm_state building and task_state spawning.
Nov 27 03:24:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:38 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e is timed out.
Nov 27 03:24:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Successfully detached device vdb from instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e from the live domain config.
Nov 27 03:24:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXncGkvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:24:38 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f150e524-e055-4088-b56c-140f52a9ecb6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:24:38 user nova-compute[75006]: No targets found.
Nov 27 03:24:38 user nova-compute[75006]: iSNS:
Nov 27 03:24:38 user nova-compute[75006]: No targets found.
Nov 27 03:24:38 user nova-compute[75006]: STATIC:
Nov 27 03:24:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469
Nov 27 03:24:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:24:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:24:38 user nova-compute[75006]: FIRMWARE:
Nov 27 03:24:38 user nova-compute[75006]: No targets found.
Nov 27 03:24:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:24:38 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:24:38 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee18492-301a-42cc-bb65-46111693efc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f7c032-0e53-4359-82ae-13211bef7755]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:24:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 (non-flash)
Nov 27 03:24:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd424171fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469'): ({'sdc'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Removing single pathed devices sdc {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26c6f3b-2a24-4192-85eb-a3eb8a3a536d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.035s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[607f97e7-11a2-4b3c-81fd-da8208ca725c]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Flushing IO for device /dev/sdc {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d812b59c-e52b-436e-86d1-ec86728c4941]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[83217ddd-5bc4-4b05-ab42-c2df20336186]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[272d77f3-f3b1-4800-8b0b-2b60e5cb354b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ce563-c84e-4de1-a2b7-cd9bf710d79f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469, portal: 172.16.0.220,3260]
Nov 27 03:24:38 user nova-compute[75006]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469, portal: 172.16.0.220,3260] successful.
Nov 27 03:24:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0ba20c6-f7b4-4313-bd00-ebcf3293b469 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[900eeda4-b5ca-4b59-a6bb-0f800ccf3aa6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] <== disconnect_volume: return (343ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:24:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'flavor' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b492c35d-7825-4f07-ab8d-79be05e0e076 tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.929s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-0992d672-2406-4f10-b5a3-d189f5b0ca01 req-523eb24b-8080-4e0a-b992-57daf1288a9b service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received event network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0992d672-2406-4f10-b5a3-d189f5b0ca01 req-523eb24b-8080-4e0a-b992-57daf1288a9b service nova] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0992d672-2406-4f10-b5a3-d189f5b0ca01 req-523eb24b-8080-4e0a-b992-57daf1288a9b service nova] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0992d672-2406-4f10-b5a3-d189f5b0ca01 req-523eb24b-8080-4e0a-b992-57daf1288a9b service nova] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-0992d672-2406-4f10-b5a3-d189f5b0ca01 req-523eb24b-8080-4e0a-b992-57daf1288a9b service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] No waiting events found dispatching network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:39 user nova-compute[75006]: WARNING nova.compute.manager [req-0992d672-2406-4f10-b5a3-d189f5b0ca01 req-523eb24b-8080-4e0a-b992-57daf1288a9b service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received unexpected event network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec for instance with vm_state building and task_state spawning.
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:24:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Instance spawned successfully.
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:40 user nova-compute[75006]: INFO nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 27 03:24:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:24:40 user nova-compute[75006]: INFO nova.compute.manager [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Took 6.89 seconds to build instance.
Nov 27 03:24:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7795544e-f2ae-41b4-8338-4c8b6ebe48c0 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.141s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:44 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:44 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:24:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:51 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:51 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=25.424083709716797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fd992ae2-0b97-47d2-9e03-f707af65f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 4921430a-67cc-418f-932f-c7249c8d2b31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:24:51 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:24:52 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:24:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:24:53 user nova-compute[75006]: INFO nova.compute.claims [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Claim successful on node user
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:24:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.policy [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c27190ecebf849039f453bcce444effa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc67e44d4444f8d8ac93ff4999c4207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:24:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Creating image(s)
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "/opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "/opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "/opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk 1073741824" returned: 0 in 0.054s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Successfully created port: 63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Cannot resize image /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Ensure instance console log exists: /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Successfully updated port: 63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquired lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-308c1cfd-b392-4e06-a5b4-66c1cf0144d9 req-8a141d23-b83a-4a0e-b9a4-b85a485d782f service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received event network-changed-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-308c1cfd-b392-4e06-a5b4-66c1cf0144d9 req-8a141d23-b83a-4a0e-b9a4-b85a485d782f service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Refreshing instance network info cache due to event network-changed-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-308c1cfd-b392-4e06-a5b4-66c1cf0144d9 req-8a141d23-b83a-4a0e-b9a4-b85a485d782f service nova] Acquiring lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Updating instance_info_cache with network_info: [{"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Releasing lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Instance network_info: |[{"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-308c1cfd-b392-4e06-a5b4-66c1cf0144d9 req-8a141d23-b83a-4a0e-b9a4-b85a485d782f service nova] Acquired lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-308c1cfd-b392-4e06-a5b4-66c1cf0144d9 req-8a141d23-b83a-4a0e-b9a4-b85a485d782f service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Refreshing network info cache for port 63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Start _get_guest_xml network_info=[{"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:24:55 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:55 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-378212485',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-378212485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3782124',id=23,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYQ57exQ6SkqrDk16gPOny/Q4Z0dRl0kVyAdhgxR1aleu7MsfYdZfTGPrlbHc6dgmiHrRqWXwsodMtk36nr7z0A6O+M/3MvU39JA96yfEOvy3RKSrMQaWWAZ9E9OPgVDg==',key_name='tempest-keypair-287732440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc67e44d4444f8d8ac93ff4999c4207',ramdisk_id='',reservation_id='r-y1du30j8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2143182561',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27190ecebf849039f453bcce444effa',uuid=32bf5b72-4409-4608-b933-8aa4b99e95ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Converting VIF {"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:26:5b,bridge_name='br-int',has_traffic_filtering=True,id=63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9,network=Network(3b5cf380-8539-4be2-8292-ee5abfc5bb52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fb8696-51') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lazy-loading 'pci_devices' on Instance uuid 32bf5b72-4409-4608-b933-8aa4b99e95ab {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:24:55 user nova-compute[75006]:   <uuid>32bf5b72-4409-4608-b933-8aa4b99e95ab</uuid>
Nov 27 03:24:55 user nova-compute[75006]:   <name>instance-00000017</name>
Nov 27 03:24:55 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:24:55 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:24:55 user nova-compute[75006]:   <metadata>
Nov 27 03:24:55 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:24:55 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:24:55 user nova-compute[75006]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-378212485</nova:name>
Nov 27 03:24:55 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:24:55</nova:creationTime>
Nov 27 03:24:55 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:24:55 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:24:55 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:24:55 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:24:55 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:24:55 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:24:55 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:24:55 user nova-compute[75006]:       <nova:owner>
Nov 27 03:24:55 user nova-compute[75006]:         <nova:user uuid="c27190ecebf849039f453bcce444effa">tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member</nova:user>
Nov 27 03:24:55 user nova-compute[75006]:         <nova:project uuid="dcc67e44d4444f8d8ac93ff4999c4207">tempest-TestServerVolumeAttachScenarioOldVersion-2143182561</nova:project>
Nov 27 03:24:55 user nova-compute[75006]:       </nova:owner>
Nov 27 03:24:55 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:24:55 user nova-compute[75006]:       <nova:ports>
Nov 27 03:24:55 user nova-compute[75006]:         <nova:port uuid="63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9">
Nov 27 03:24:55 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:24:55 user nova-compute[75006]:         </nova:port>
Nov 27 03:24:55 user nova-compute[75006]:       </nova:ports>
Nov 27 03:24:55 user nova-compute[75006]:     </nova:instance>
Nov 27 03:24:55 user nova-compute[75006]:   </metadata>
Nov 27 03:24:55 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:24:55 user nova-compute[75006]:     <system>
Nov 27 03:24:55 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:24:55 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:24:55 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:24:55 user nova-compute[75006]:       <entry name="serial">32bf5b72-4409-4608-b933-8aa4b99e95ab</entry>
Nov 27 03:24:55 user nova-compute[75006]:       <entry name="uuid">32bf5b72-4409-4608-b933-8aa4b99e95ab</entry>
Nov 27 03:24:55 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:24:55 user nova-compute[75006]:     </system>
Nov 27 03:24:55 user nova-compute[75006]:   </sysinfo>
Nov 27 03:24:55 user nova-compute[75006]:   <os>
Nov 27 03:24:55 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:24:55 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:24:55 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:24:55 user nova-compute[75006]:   </os>
Nov 27 03:24:55 user nova-compute[75006]:   <features>
Nov 27 03:24:55 user nova-compute[75006]:     <acpi/>
Nov 27 03:24:55 user nova-compute[75006]:     <apic/>
Nov 27 03:24:55 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:24:55 user nova-compute[75006]:   </features>
Nov 27 03:24:55 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:24:55 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:24:55 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:24:55 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:24:55 user nova-compute[75006]:   </clock>
Nov 27 03:24:55 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:24:55 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:24:55 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:24:55 user nova-compute[75006]:   </cpu>
Nov 27 03:24:55 user nova-compute[75006]:   <devices>
Nov 27 03:24:55 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:24:55 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:24:55 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk"/>
Nov 27 03:24:55 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:24:55 user nova-compute[75006]:     </disk>
Nov 27 03:24:55 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:24:55 user nova-compute[75006]:       <mac address="fa:16:3e:8e:26:5b"/>
Nov 27 03:24:55 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:24:55 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:24:55 user nova-compute[75006]:       <target dev="tap63fb8696-51"/>
Nov 27 03:24:55 user nova-compute[75006]:     </interface>
Nov 27 03:24:55 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:24:55 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/console.log" append="off"/>
Nov 27 03:24:55 user nova-compute[75006]:     </serial>
Nov 27 03:24:55 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:24:55 user nova-compute[75006]:     <video>
Nov 27 03:24:55 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:24:55 user nova-compute[75006]:     </video>
Nov 27 03:24:55 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:24:55 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:24:55 user nova-compute[75006]:     </rng>
Nov 27 03:24:55 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:24:55 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:24:55 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:24:55 user nova-compute[75006]:     </memballoon>
Nov 27 03:24:55 user nova-compute[75006]:   </devices>
Nov 27 03:24:55 user nova-compute[75006]: </domain>
Nov 27 03:24:55 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-378212485',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-378212485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3782124',id=23,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYQ57exQ6SkqrDk16gPOny/Q4Z0dRl0kVyAdhgxR1aleu7MsfYdZfTGPrlbHc6dgmiHrRqWXwsodMtk36nr7z0A6O+M/3MvU39JA96yfEOvy3RKSrMQaWWAZ9E9OPgVDg==',key_name='tempest-keypair-287732440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc67e44d4444f8d8ac93ff4999c4207',ramdisk_id='',reservation_id='r-y1du30j8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2143182561',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27190ecebf849039f453bcce444effa',uuid=32bf5b72-4409-4608-b933-8aa4b99e95ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Converting VIF {"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:26:5b,bridge_name='br-int',has_traffic_filtering=True,id=63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9,network=Network(3b5cf380-8539-4be2-8292-ee5abfc5bb52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fb8696-51') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG os_vif [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:26:5b,bridge_name='br-int',has_traffic_filtering=True,id=63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9,network=Network(3b5cf380-8539-4be2-8292-ee5abfc5bb52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fb8696-51') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5b7afa9-c84b-5a0a-8ada-b49729434479', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63fb8696-51, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63fb8696-51, col_values=(('qos', UUID('eeb0916e-beda-4c2d-9c06-0ce4fd15d170')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63fb8696-51, col_values=(('external_ids', {'iface-id': '63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:26:5b', 'vm-uuid': '32bf5b72-4409-4608-b933-8aa4b99e95ab'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:55 user nova-compute[75006]: INFO os_vif [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:26:5b,bridge_name='br-int',has_traffic_filtering=True,id=63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9,network=Network(3b5cf380-8539-4be2-8292-ee5abfc5bb52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fb8696-51')
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] No VIF found with MAC fa:16:3e:8e:26:5b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-308c1cfd-b392-4e06-a5b4-66c1cf0144d9 req-8a141d23-b83a-4a0e-b9a4-b85a485d782f service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Updated VIF entry in instance network info cache for port 63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-308c1cfd-b392-4e06-a5b4-66c1cf0144d9 req-8a141d23-b83a-4a0e-b9a4-b85a485d782f service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Updating instance_info_cache with network_info: [{"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:24:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-308c1cfd-b392-4e06-a5b4-66c1cf0144d9 req-8a141d23-b83a-4a0e-b9a4-b85a485d782f service nova] Releasing lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:24:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-ad7aa13d-483b-469e-814e-38ff6d2625e7 req-35d77094-24a7-4579-bd1a-d36836a0851a service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received event network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ad7aa13d-483b-469e-814e-38ff6d2625e7 req-35d77094-24a7-4579-bd1a-d36836a0851a service nova] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ad7aa13d-483b-469e-814e-38ff6d2625e7 req-35d77094-24a7-4579-bd1a-d36836a0851a service nova] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ad7aa13d-483b-469e-814e-38ff6d2625e7 req-35d77094-24a7-4579-bd1a-d36836a0851a service nova] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-ad7aa13d-483b-469e-814e-38ff6d2625e7 req-35d77094-24a7-4579-bd1a-d36836a0851a service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] No waiting events found dispatching network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:57 user nova-compute[75006]: WARNING nova.compute.manager [req-ad7aa13d-483b-469e-814e-38ff6d2625e7 req-35d77094-24a7-4579-bd1a-d36836a0851a service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received unexpected event network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 for instance with vm_state building and task_state spawning.
Nov 27 03:24:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:24:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:24:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:24:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Instance spawned successfully.
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:24:59 user nova-compute[75006]: INFO nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:24:59 user nova-compute[75006]: INFO nova.compute.manager [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Took 6.08 seconds to build instance.
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-d1cd54df-a1a8-47db-a858-1a1183ae0325 req-bef173a9-8fd9-49f8-9926-1e8d6d6366a3 service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received event network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1cd54df-a1a8-47db-a858-1a1183ae0325 req-bef173a9-8fd9-49f8-9926-1e8d6d6366a3 service nova] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1cd54df-a1a8-47db-a858-1a1183ae0325 req-bef173a9-8fd9-49f8-9926-1e8d6d6366a3 service nova] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1cd54df-a1a8-47db-a858-1a1183ae0325 req-bef173a9-8fd9-49f8-9926-1e8d6d6366a3 service nova] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-d1cd54df-a1a8-47db-a858-1a1183ae0325 req-bef173a9-8fd9-49f8-9926-1e8d6d6366a3 service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] No waiting events found dispatching network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:24:59 user nova-compute[75006]: WARNING nova.compute.manager [req-d1cd54df-a1a8-47db-a858-1a1183ae0325 req-bef173a9-8fd9-49f8-9926-1e8d6d6366a3 service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received unexpected event network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 for instance with vm_state active and task_state None.
Nov 27 03:24:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a5f013b-c9fa-4516-8894-62fc35b332ad tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.226s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:24:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:25:07 user nova-compute[75006]: INFO nova.compute.claims [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Claim successful on node user
Nov 27 03:25:07 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:25:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:25:07 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:25:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG nova.policy [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bdc7ee98a95432d96679fc697b7d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bbdcea84574886bbea67eefc84dca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:25:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Creating image(s)
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "/opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "/opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.215s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk 1073741824" returned: 0 in 0.052s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.198s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:08 user nova-compute[75006]: INFO nova.compute.manager [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Terminating instance
Nov 27 03:25:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Cannot resize image /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Ensure instance console log exists: /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-db17e71d-fc68-4c58-9366-e666e302c5a4 req-bb1538cc-63b9-4e2b-ac1e-ea06daca5bf2 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db17e71d-fc68-4c58-9366-e666e302c5a4 req-bb1538cc-63b9-4e2b-ac1e-ea06daca5bf2 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db17e71d-fc68-4c58-9366-e666e302c5a4 req-bb1538cc-63b9-4e2b-ac1e-ea06daca5bf2 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-db17e71d-fc68-4c58-9366-e666e302c5a4 req-bb1538cc-63b9-4e2b-ac1e-ea06daca5bf2 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-db17e71d-fc68-4c58-9366-e666e302c5a4 req-bb1538cc-63b9-4e2b-ac1e-ea06daca5bf2 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-db17e71d-fc68-4c58-9366-e666e302c5a4 req-bb1538cc-63b9-4e2b-ac1e-ea06daca5bf2 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-unplugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Successfully created port: 2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Instance destroyed successfully.
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.objects.instance [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lazy-loading 'resources' on Instance uuid fa069296-0bb8-4b82-bedf-d1a8d8cd104e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-166334771',display_name='tempest-ServerStableDeviceRescueTest-server-166334771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-166334771',id=5,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkrvgso/+qYjDfRCrx5012kbek4Rd4RdwB6W/v4Ei54TxDnuJEm+BKPDOZU4Pzpb/hPvWhcT2lFjZjpaZ+X06ujo/JFr4LnGzCr1Fw0qFZv6B92syOK38/REaSqI9jAwg==',key_name='tempest-keypair-236960693',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bfddf9022e8d4376ac00c17e04118132',ramdisk_id='',reservation_id='r-pfp5lkz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-303496041',owner_user_name='tempest-ServerStableDeviceRescueTest-303496041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:23:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204e517cbd36494c94ee36e63da3acb6',uuid=fa069296-0bb8-4b82-bedf-d1a8d8cd104e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Converting VIF {"id": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "address": "fa:16:3e:8f:6e:07", "network": {"id": "f054fb9a-ad51-4dc5-9d8e-531acafaad88", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1635012399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bfddf9022e8d4376ac00c17e04118132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf94812d5-e0", "ovs_interfaceid": "f94812d5-e03a-40d6-88c1-6fe71880aa1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:6e:07,bridge_name='br-int',has_traffic_filtering=True,id=f94812d5-e03a-40d6-88c1-6fe71880aa1d,network=Network(f054fb9a-ad51-4dc5-9d8e-531acafaad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94812d5-e0') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG os_vif [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:6e:07,bridge_name='br-int',has_traffic_filtering=True,id=f94812d5-e03a-40d6-88c1-6fe71880aa1d,network=Network(f054fb9a-ad51-4dc5-9d8e-531acafaad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94812d5-e0') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf94812d5-e0, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cd126ea-f90e-49bb-8d66-650c4dae6321) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: INFO os_vif [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:6e:07,bridge_name='br-int',has_traffic_filtering=True,id=f94812d5-e03a-40d6-88c1-6fe71880aa1d,network=Network(f054fb9a-ad51-4dc5-9d8e-531acafaad88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf94812d5-e0')
Nov 27 03:25:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Deleting instance files /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e_del
Nov 27 03:25:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Deletion of /opt/stack/data/nova/instances/fa069296-0bb8-4b82-bedf-d1a8d8cd104e_del complete
Nov 27 03:25:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:09 user nova-compute[75006]: INFO nova.compute.manager [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 27 03:25:09 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Successfully updated port: 2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquired lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:25:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-4976cbee-d7dc-48ef-91e8-9377292777f7 req-e80aecfa-d4f3-40f3-af6c-9168faac8034 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received event network-changed-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-4976cbee-d7dc-48ef-91e8-9377292777f7 req-e80aecfa-d4f3-40f3-af6c-9168faac8034 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Refreshing instance network info cache due to event network-changed-2a181ab5-f536-4562-a7a0-fcb24fd36438. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4976cbee-d7dc-48ef-91e8-9377292777f7 req-e80aecfa-d4f3-40f3-af6c-9168faac8034 service nova] Acquiring lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updating instance_info_cache with network_info: [{"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Releasing lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Instance network_info: |[{"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4976cbee-d7dc-48ef-91e8-9377292777f7 req-e80aecfa-d4f3-40f3-af6c-9168faac8034 service nova] Acquired lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-4976cbee-d7dc-48ef-91e8-9377292777f7 req-e80aecfa-d4f3-40f3-af6c-9168faac8034 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Refreshing network info cache for port 2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Start _get_guest_xml network_info=[{"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:25:10 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1602843479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1602843479',id=24,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-ssyqvaw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:25:08Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:85:18,bridge_name='br-int',has_traffic_filtering=True,id=2a181ab5-f536-4562-a7a0-fcb24fd36438,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a181ab5-f5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'pci_devices' on Instance uuid c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:25:10 user nova-compute[75006]:   <uuid>c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec</uuid>
Nov 27 03:25:10 user nova-compute[75006]:   <name>instance-00000018</name>
Nov 27 03:25:10 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:25:10 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:25:10 user nova-compute[75006]:   <metadata>
Nov 27 03:25:10 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:25:10 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:25:10 user nova-compute[75006]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1602843479</nova:name>
Nov 27 03:25:10 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:25:10</nova:creationTime>
Nov 27 03:25:10 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:25:10 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:25:10 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:25:10 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:25:10 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:25:10 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:25:10 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:25:10 user nova-compute[75006]:       <nova:owner>
Nov 27 03:25:10 user nova-compute[75006]:         <nova:user uuid="7bdc7ee98a95432d96679fc697b7d61d">tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member</nova:user>
Nov 27 03:25:10 user nova-compute[75006]:         <nova:project uuid="03bbdcea84574886bbea67eefc84dca0">tempest-ServerBootFromVolumeStableRescueTest-2135085811</nova:project>
Nov 27 03:25:10 user nova-compute[75006]:       </nova:owner>
Nov 27 03:25:10 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:25:10 user nova-compute[75006]:       <nova:ports>
Nov 27 03:25:10 user nova-compute[75006]:         <nova:port uuid="2a181ab5-f536-4562-a7a0-fcb24fd36438">
Nov 27 03:25:10 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 03:25:10 user nova-compute[75006]:         </nova:port>
Nov 27 03:25:10 user nova-compute[75006]:       </nova:ports>
Nov 27 03:25:10 user nova-compute[75006]:     </nova:instance>
Nov 27 03:25:10 user nova-compute[75006]:   </metadata>
Nov 27 03:25:10 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:25:10 user nova-compute[75006]:     <system>
Nov 27 03:25:10 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:25:10 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:25:10 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:25:10 user nova-compute[75006]:       <entry name="serial">c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec</entry>
Nov 27 03:25:10 user nova-compute[75006]:       <entry name="uuid">c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec</entry>
Nov 27 03:25:10 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:25:10 user nova-compute[75006]:     </system>
Nov 27 03:25:10 user nova-compute[75006]:   </sysinfo>
Nov 27 03:25:10 user nova-compute[75006]:   <os>
Nov 27 03:25:10 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:25:10 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:25:10 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:25:10 user nova-compute[75006]:   </os>
Nov 27 03:25:10 user nova-compute[75006]:   <features>
Nov 27 03:25:10 user nova-compute[75006]:     <acpi/>
Nov 27 03:25:10 user nova-compute[75006]:     <apic/>
Nov 27 03:25:10 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:25:10 user nova-compute[75006]:   </features>
Nov 27 03:25:10 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:25:10 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:25:10 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:25:10 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:25:10 user nova-compute[75006]:   </clock>
Nov 27 03:25:10 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:25:10 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:25:10 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:25:10 user nova-compute[75006]:   </cpu>
Nov 27 03:25:10 user nova-compute[75006]:   <devices>
Nov 27 03:25:10 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:25:10 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:25:10 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk"/>
Nov 27 03:25:10 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:25:10 user nova-compute[75006]:     </disk>
Nov 27 03:25:10 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:25:10 user nova-compute[75006]:       <mac address="fa:16:3e:3e:85:18"/>
Nov 27 03:25:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:25:10 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:25:10 user nova-compute[75006]:       <target dev="tap2a181ab5-f5"/>
Nov 27 03:25:10 user nova-compute[75006]:     </interface>
Nov 27 03:25:10 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:25:10 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/console.log" append="off"/>
Nov 27 03:25:10 user nova-compute[75006]:     </serial>
Nov 27 03:25:10 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:25:10 user nova-compute[75006]:     <video>
Nov 27 03:25:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:25:10 user nova-compute[75006]:     </video>
Nov 27 03:25:10 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:25:10 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:25:10 user nova-compute[75006]:     </rng>
Nov 27 03:25:10 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:25:10 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:25:10 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:25:10 user nova-compute[75006]:     </memballoon>
Nov 27 03:25:10 user nova-compute[75006]:   </devices>
Nov 27 03:25:10 user nova-compute[75006]: </domain>
Nov 27 03:25:10 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1602843479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1602843479',id=24,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-ssyqvaw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:25:08Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:85:18,bridge_name='br-int',has_traffic_filtering=True,id=2a181ab5-f536-4562-a7a0-fcb24fd36438,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a181ab5-f5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG os_vif [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:85:18,bridge_name='br-int',has_traffic_filtering=True,id=2a181ab5-f536-4562-a7a0-fcb24fd36438,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a181ab5-f5') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50ca99a6-d1d7-5a13-beb6-980e50fff9f2', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a181ab5-f5, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a181ab5-f5, col_values=(('qos', UUID('a8818757-8d12-4f3a-8d29-2a341ba6df7d')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a181ab5-f5, col_values=(('external_ids', {'iface-id': '2a181ab5-f536-4562-a7a0-fcb24fd36438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:85:18', 'vm-uuid': 'c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:10 user nova-compute[75006]: INFO os_vif [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:85:18,bridge_name='br-int',has_traffic_filtering=True,id=2a181ab5-f536-4562-a7a0-fcb24fd36438,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a181ab5-f5')
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No VIF found with MAC fa:16:3e:3e:85:18, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-4976cbee-d7dc-48ef-91e8-9377292777f7 req-e80aecfa-d4f3-40f3-af6c-9168faac8034 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updated VIF entry in instance network info cache for port 2a181ab5-f536-4562-a7a0-fcb24fd36438. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-4976cbee-d7dc-48ef-91e8-9377292777f7 req-e80aecfa-d4f3-40f3-af6c-9168faac8034 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updating instance_info_cache with network_info: [{"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4976cbee-d7dc-48ef-91e8-9377292777f7 req-e80aecfa-d4f3-40f3-af6c-9168faac8034 service nova] Releasing lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:25:10 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Took 1.21 seconds to deallocate network for instance.
Nov 27 03:25:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:11 user nova-compute[75006]: WARNING nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state deleted and task_state None.
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:11 user nova-compute[75006]: WARNING nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state deleted and task_state None.
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:11 user nova-compute[75006]: WARNING nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state deleted and task_state None.
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Acquiring lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] No waiting events found dispatching network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:11 user nova-compute[75006]: WARNING nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received unexpected event network-vif-plugged-f94812d5-e03a-40d6-88c1-6fe71880aa1d for instance with vm_state deleted and task_state None.
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ddf08d8-a763-464a-b5df-80625122b1c0 req-90b15f37-7351-49c8-8841-57ae2af19452 service nova] [instance: fa069296-0bb8-4b82-bedf-d1a8d8cd104e] Received event network-vif-deleted-f94812d5-e03a-40d6-88c1-6fe71880aa1d {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:11 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Deleted allocations for instance fa069296-0bb8-4b82-bedf-d1a8d8cd104e
Nov 27 03:25:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-448d7b27-340a-44b4-967b-1c1702f1caee tempest-ServerStableDeviceRescueTest-303496041 tempest-ServerStableDeviceRescueTest-303496041-project-member] Lock "fa069296-0bb8-4b82-bedf-d1a8d8cd104e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.678s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-13e491b7-ae76-40dd-b356-3dd00f5f10ea req-c3a62a1d-390b-4662-9124-da667a878ba2 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received event network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-13e491b7-ae76-40dd-b356-3dd00f5f10ea req-c3a62a1d-390b-4662-9124-da667a878ba2 service nova] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-13e491b7-ae76-40dd-b356-3dd00f5f10ea req-c3a62a1d-390b-4662-9124-da667a878ba2 service nova] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-13e491b7-ae76-40dd-b356-3dd00f5f10ea req-c3a62a1d-390b-4662-9124-da667a878ba2 service nova] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-13e491b7-ae76-40dd-b356-3dd00f5f10ea req-c3a62a1d-390b-4662-9124-da667a878ba2 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] No waiting events found dispatching network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:12 user nova-compute[75006]: WARNING nova.compute.manager [req-13e491b7-ae76-40dd-b356-3dd00f5f10ea req-c3a62a1d-390b-4662-9124-da667a878ba2 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received unexpected event network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 for instance with vm_state building and task_state spawning.
Nov 27 03:25:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:25:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Instance spawned successfully.
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:25:13 user nova-compute[75006]: INFO nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 27 03:25:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:25:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-5f98fc14-d58d-4d2b-a200-535f3450989a req-406fbc22-71ff-4df1-8896-855125aa1917 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received event network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f98fc14-d58d-4d2b-a200-535f3450989a req-406fbc22-71ff-4df1-8896-855125aa1917 service nova] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f98fc14-d58d-4d2b-a200-535f3450989a req-406fbc22-71ff-4df1-8896-855125aa1917 service nova] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f98fc14-d58d-4d2b-a200-535f3450989a req-406fbc22-71ff-4df1-8896-855125aa1917 service nova] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-5f98fc14-d58d-4d2b-a200-535f3450989a req-406fbc22-71ff-4df1-8896-855125aa1917 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] No waiting events found dispatching network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:14 user nova-compute[75006]: WARNING nova.compute.manager [req-5f98fc14-d58d-4d2b-a200-535f3450989a req-406fbc22-71ff-4df1-8896-855125aa1917 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received unexpected event network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 for instance with vm_state building and task_state spawning.
Nov 27 03:25:14 user nova-compute[75006]: INFO nova.compute.manager [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Took 6.78 seconds to build instance.
Nov 27 03:25:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b32b71ef-7d32-40e0-8861-ca4fb26625f3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.880s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-6f504e6b-92ce-4888-91af-c12754143f73 req-1b7605b4-6ad6-4c07-874b-b2b82a418a4c service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Received event network-changed-1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-6f504e6b-92ce-4888-91af-c12754143f73 req-1b7605b4-6ad6-4c07-874b-b2b82a418a4c service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Refreshing instance network info cache due to event network-changed-1a39f5fd-b558-47c4-bda3-3248d68aa175. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:25:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6f504e6b-92ce-4888-91af-c12754143f73 req-1b7605b4-6ad6-4c07-874b-b2b82a418a4c service nova] Acquiring lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:25:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6f504e6b-92ce-4888-91af-c12754143f73 req-1b7605b4-6ad6-4c07-874b-b2b82a418a4c service nova] Acquired lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:25:25 user nova-compute[75006]: DEBUG nova.network.neutron [req-6f504e6b-92ce-4888-91af-c12754143f73 req-1b7605b4-6ad6-4c07-874b-b2b82a418a4c service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Refreshing network info cache for port 1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG nova.network.neutron [req-6f504e6b-92ce-4888-91af-c12754143f73 req-1b7605b4-6ad6-4c07-874b-b2b82a418a4c service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updated VIF entry in instance network info cache for port 1a39f5fd-b558-47c4-bda3-3248d68aa175. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG nova.network.neutron [req-6f504e6b-92ce-4888-91af-c12754143f73 req-1b7605b4-6ad6-4c07-874b-b2b82a418a4c service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updating instance_info_cache with network_info: [{"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6f504e6b-92ce-4888-91af-c12754143f73 req-1b7605b4-6ad6-4c07-874b-b2b82a418a4c service nova] Releasing lock "refresh_cache-4921430a-67cc-418f-932f-c7249c8d2b31" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lazy-loading 'flavor' on Instance uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:26 user nova-compute[75006]: INFO nova.compute.manager [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Attaching volume bc2f8e73-674d-4ca3-a1a2-125d3948c842 to /dev/vdb
Nov 27 03:25:26 user nova-compute[75006]: DEBUG os_brick.utils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ce52d8-e962-4257-9d9c-34c9ff287d73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4b19b-c395-4570-bd7c-c02713e52469]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8672e04b-6375-49cc-8092-c79bc48e88f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc316d-197e-46e1-85af-c93277ae8889]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:25:26 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:25:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9026e439-3498-4a54-ab45-9c3e05b27b8c]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG os_brick.utils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updating existing volume attachment record: b918cb40-6cdb-46a9-998f-48775fd56831 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:25:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfUsWoRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:25:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:25:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:25:32 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36a3e3c-3e7e-4299-88ea-034bda73dd4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:25:32 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf94c53-edb0-4e8a-8c07-3fcfc0e4e110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842] added
Nov 27 03:25:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0127bcd0-aaea-4452-a702-52c3fe2b4f70]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4fbd50-c328-48e2-8caf-dc4196f5bd90]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YfUsWoRS {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YfUsWoRS" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19df60c-3ea1-4cf1-a883-0b10dbe14cfb]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YfUsWoRS'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac2990-b7ca-49df-96c6-dfd7305a2c54]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec94917-e452-4cf9-8d89-5793a76d04a0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 03:25:33 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 03:25:33 user nova-compute[75006]:  {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:25:33 user nova-compute[75006]: WARNING os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 03:25:33 user nova-compute[75006]: 
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875d820-579b-438d-bb62-ec660eedff3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842, portal: 172.16.0.220,3260]
Nov 27 03:25:33 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842, portal: 172.16.0.220,3260] successful.
Nov 27 03:25:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f989c7-d509-4059-bb11-e2d4f9042171]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fa2d26-6d00-4e43-bd5f-d90b4ff9bc47]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6906540-62d2-4a00-9e7b-491f54942312]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:25:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfUsWoRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23636353337323064', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636353337323064', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lazy-loading 'flavor' on Instance uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:25:34 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:25:34 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:25:34 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:25:34 user nova-compute[75006]:   <serial>bc2f8e73-674d-4ca3-a1a2-125d3948c842</serial>
Nov 27 03:25:34 user nova-compute[75006]: </disk>
Nov 27 03:25:34 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No VIF found with MAC fa:16:3e:f3:a9:82, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:25:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b10c3e99-d0f8-4539-9eda-cb5eacfb3a8d tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.148s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lazy-loading 'flavor' on Instance uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:39 user nova-compute[75006]: INFO nova.compute.manager [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Attaching volume 3dc678f1-d215-4adf-ae2f-438025951cb8 to /dev/vdc
Nov 27 03:25:39 user nova-compute[75006]: DEBUG os_brick.utils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d2af68-e0da-48a5-a650-57a989af4619]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d715912c-3760-4807-86ef-34812bf44814]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b4f76-b44c-4528-95c6-335701af48c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d893a69-b680-4996-bf51-fd8608ff078b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:25:39 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:25:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[922234b6-9d96-4a83-b7b8-bb3ca0836dd1]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG os_brick.utils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:25:39 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updating existing volume attachment record: 83e94293-e029-428f-a346-d0d674c7dd17 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:25:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lazy-loading 'flavor' on Instance uuid e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:42 user nova-compute[75006]: INFO nova.compute.manager [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Attaching volume be037b90-f73b-4a57-a875-6944371554e7 to /dev/vdb
Nov 27 03:25:42 user nova-compute[75006]: DEBUG os_brick.utils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb4e02d-cd80-4d6d-b718-bbfd9e31f629]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc8ac38-4eeb-4094-b4bf-c0c9dda874c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[329a9f1f-7811-41dd-a933-a4d704137bf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c471c6f0-d72a-4d51-bcbb-e80cd5658df1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:25:42 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:25:42 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5260d2e3-97a9-4893-a5a3-cb10d82201d9]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG os_brick.utils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:25:42 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating existing volume attachment record: 191a335d-7ebf-492a-8864-44483eb58081 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:25:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irKymaek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:25:46 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:25:46 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:25:46 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d67c05-d0d5-4f08-995d-194278839205]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:25:46 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1074ab40-6fb0-4346-a1a0-db31cab852a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8] added
Nov 27 03:25:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236a6a2-ce63-4b84-a848-c87f0f59f982]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d667b32-1695-4eb8-93a0-3fd499ab760a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irKymaek {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irKymaek" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe8b389-744b-4515-b812-85804b5e5a68]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'irKymaek'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d422ce95-c816-4614-b317-4359821eeb1b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7b88a-f7b9-462c-afb4-11457f2964af]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff3097d-8419-4d9e-9483-fbb4d3289db9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8, portal: 172.16.0.220,3260]
Nov 27 03:25:46 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8, portal: 172.16.0.220,3260] successful.
Nov 27 03:25:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[911cad09-96ec-43ba-bdfc-1db0e0340f7c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[505276d1-320b-4d9f-9694-5ccd5adc9f38]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:46 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:25:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:46 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:25:46 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1833cf0c-fd4b-4031-afb1-07ff3ae274a7]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irKymaek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:46 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26363653035303637', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363653035303637', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lazy-loading 'flavor' on Instance uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:25:47 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:25:47 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:25:47 user nova-compute[75006]:   <target dev="vdc" bus="virtio"/>
Nov 27 03:25:47 user nova-compute[75006]:   <serial>3dc678f1-d215-4adf-ae2f-438025951cb8</serial>
Nov 27 03:25:47 user nova-compute[75006]: </disk>
Nov 27 03:25:47 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:25:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] No VIF found with MAC fa:16:3e:f3:a9:82, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b0c8d914-30d7-4e17-8c43-f880d6286add tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.402s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:48 user nova-compute[75006]: INFO nova.compute.manager [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Detaching volume 3dc678f1-d215-4adf-ae2f-438025951cb8
Nov 27 03:25:48 user nova-compute[75006]: INFO nova.virt.block_device [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Attempting to driver detach volume 3dc678f1-d215-4adf-ae2f-438025951cb8 from mountpoint /dev/vdc
Nov 27 03:25:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Attempting to detach device vdc from instance 4921430a-67cc-418f-932f-c7249c8d2b31 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:25:48 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:25:48 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:25:48 user nova-compute[75006]:   <target dev="vdc" bus="virtio"/>
Nov 27 03:25:48 user nova-compute[75006]:   <serial>3dc678f1-d215-4adf-ae2f-438025951cb8</serial>
Nov 27 03:25:48 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 03:25:48 user nova-compute[75006]: </disk>
Nov 27 03:25:48 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:25:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Successfully detached device vdc from instance 4921430a-67cc-418f-932f-c7249c8d2b31 from the persistent domain config.
Nov 27 03:25:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4921430a-67cc-418f-932f-c7249c8d2b31 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:25:48 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:25:48 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:25:48 user nova-compute[75006]:   <target dev="vdc" bus="virtio"/>
Nov 27 03:25:48 user nova-compute[75006]:   <serial>3dc678f1-d215-4adf-ae2f-438025951cb8</serial>
Nov 27 03:25:48 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 03:25:48 user nova-compute[75006]: </disk>
Nov 27 03:25:48 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:48 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.362s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:25:51 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:25:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:25:51 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:25:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:25:51 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f300f2-f11a-46ef-9139-d5728fd98cb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:25:52 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f8787-442d-4fee-b6f1-f9f5e12a4b47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7] added
Nov 27 03:25:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33145f6-7489-472a-903a-c27f60fe644f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e336e8-1947-4c1a-af90-403b6a0cbe58]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqFPOaxz {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqFPOaxz" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d56706-977a-490b-b9ea-d6436ecfc223]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqFPOaxz'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3befde-012c-4121-960b-2bf7b0c2e158]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa3ce6f-848c-4943-a8ae-1ee9ccbdf3b7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f1487-665a-403c-aa8c-dd0ff8cef5c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]
Nov 27 03:25:52 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.
Nov 27 03:25:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[beecf5b6-0f41-493a-a597-be0d9446a6c0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[59245ba6-a140-4e4f-9050-7978d0b482a5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:25:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fe3cc2-ccf9-44af-ba8f-08479e8bdfac]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23938326433366139', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326433366139', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG nova.objects.instance [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lazy-loading 'flavor' on Instance uuid e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:25:53 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:25:53 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:25:53 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:25:53 user nova-compute[75006]:   <serial>be037b90-f73b-4a57-a875-6944371554e7</serial>
Nov 27 03:25:53 user nova-compute[75006]: </disk>
Nov 27 03:25:53 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:25:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:54 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:25:54 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7451MB free_disk=25.423324584960938GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] No VIF found with MAC fa:16:3e:d9:f7:5f, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance fd992ae2-0b97-47d2-9e03-f707af65f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 4921430a-67cc-418f-932f-c7249c8d2b31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 32bf5b72-4409-4608-b933-8aa4b99e95ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-984d55ac-376a-49ab-bf12-6be4dcbb42fa tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.967s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:25:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:25:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid fd992ae2-0b97-47d2-9e03-f707af65f190 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Updating instance_info_cache with network_info: [{"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-fd992ae2-0b97-47d2-9e03-f707af65f190" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Stashing vm_state: active {{(pid=75006) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:25:56 user nova-compute[75006]: INFO nova.compute.claims [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Claim successful on node user
Nov 27 03:25:56 user nova-compute[75006]: INFO nova.compute.resource_tracker [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating resource usage from migration b695dec7-47e0-43c3-baf4-14dd85effaf2
Nov 27 03:25:56 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.386s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:56 user nova-compute[75006]: INFO nova.compute.manager [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Migrating
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:25:56 user nova-compute[75006]: INFO nova.compute.rpcapi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquired lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:25:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Releasing lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Starting migrate_disk_and_power_off {{(pid=75006) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-87e7a9ef-05d8-4109-840e-148fdce055db req-21af7132-684f-4a6a-960a-b80bfc1723d8 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-87e7a9ef-05d8-4109-840e-148fdce055db req-21af7132-684f-4a6a-960a-b80bfc1723d8 service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-87e7a9ef-05d8-4109-840e-148fdce055db req-21af7132-684f-4a6a-960a-b80bfc1723d8 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-87e7a9ef-05d8-4109-840e-148fdce055db req-21af7132-684f-4a6a-960a-b80bfc1723d8 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-87e7a9ef-05d8-4109-840e-148fdce055db req-21af7132-684f-4a6a-960a-b80bfc1723d8 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:57 user nova-compute[75006]: WARNING nova.compute.manager [req-87e7a9ef-05d8-4109-840e-148fdce055db req-21af7132-684f-4a6a-960a-b80bfc1723d8 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state active and task_state resize_migrating.
Nov 27 03:25:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance destroyed successfully.
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-805329585-network", "vif_mac": "fa:16:3e:d9:f7:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-805329585-network", "vif_mac": "fa:16:3e:d9:f7:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_vif [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01db2ae6-9b, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9d640a3-2383-447e-baa9-c97e304d2c59) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:58 user nova-compute[75006]: INFO os_vif [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b')
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:25:58 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[879a1bc4-a42c-4036-844f-3eb7c1b14eb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:25:58 user nova-compute[75006]: No targets found.
Nov 27 03:25:58 user nova-compute[75006]: iSNS:
Nov 27 03:25:58 user nova-compute[75006]: No targets found.
Nov 27 03:25:58 user nova-compute[75006]: STATIC:
Nov 27 03:25:58 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8
Nov 27 03:25:58 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:25:58 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:25:58 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842
Nov 27 03:25:58 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:25:58 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:25:58 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:25:58 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:25:58 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:25:58 user nova-compute[75006]: FIRMWARE:
Nov 27 03:25:58 user nova-compute[75006]: No targets found.
Nov 27 03:25:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:25:58 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:25:58 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1493bdd3-165c-4542-9cd7-ba906cacd6ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fafcf7-3119-4431-8a9e-816bff07ca1c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:58 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:25:58 user nova-compute[75006]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:25:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:25:58 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:25:58 user nova-compute[75006]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:25:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241727a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[01086ba9-74ad-400b-86ac-f1053234a6b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f696f9df-cd1e-4ea2-b84f-da3cec4be69e]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[12818741-1815-4e3e-898d-020d03ab247d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab73fb9e-b94c-4f38-a07d-c23673d1df2d]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f871677-dc0f-4293-8b36-115c0754235f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce4172-7e63-4d5a-8c27-92e154b08855]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]
Nov 27 03:25:58 user nova-compute[75006]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.
Nov 27 03:25:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b9ea6f-d889-4767-bf76-3cb5aa4055e9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== disconnect_volume: return (350ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquired lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'info_cache' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.objects.base [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:25:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1_resize/disk /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "cp -r /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1_resize/disk /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk" returned: 0 in 0.286s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1_resize/disk.info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk.info {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "cp -r /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1_resize/disk.info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk.info" returned: 0 in 0.044s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Releasing lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:25:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance destroyed successfully.
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'resources' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.base [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:24:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG os_vif [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f7e81ab-18, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39630b99-3411-475a-940f-1810df380c45) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:25:59 user nova-compute[75006]: INFO os_vif [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18')
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Start _get_guest_xml network_info=[{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'numa_topology' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.base [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:25:59 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:25:59 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'vcpu_model' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.base [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:24:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'pci_devices' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.base [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:25:59 user nova-compute[75006]:   <uuid>70a4bf10-12f0-4b99-baa2-53be7becbb21</uuid>
Nov 27 03:25:59 user nova-compute[75006]:   <name>instance-00000003</name>
Nov 27 03:25:59 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:25:59 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:25:59 user nova-compute[75006]:   <metadata>
Nov 27 03:25:59 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:25:59 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:25:59 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeTestJSON-server-1573842622</nova:name>
Nov 27 03:25:59 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:25:59</nova:creationTime>
Nov 27 03:25:59 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:25:59 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:25:59 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:25:59 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:25:59 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:25:59 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:25:59 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:25:59 user nova-compute[75006]:       <nova:owner>
Nov 27 03:25:59 user nova-compute[75006]:         <nova:user uuid="1275432e762e409d92b00e7c3303de53">tempest-AttachVolumeTestJSON-245260319-project-member</nova:user>
Nov 27 03:25:59 user nova-compute[75006]:         <nova:project uuid="9c41971e35b24517acd8b84a22e14b97">tempest-AttachVolumeTestJSON-245260319</nova:project>
Nov 27 03:25:59 user nova-compute[75006]:       </nova:owner>
Nov 27 03:25:59 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:25:59 user nova-compute[75006]:       <nova:ports>
Nov 27 03:25:59 user nova-compute[75006]:         <nova:port uuid="1f7e81ab-1878-407b-a8fe-02ea2918ff76">
Nov 27 03:25:59 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 03:25:59 user nova-compute[75006]:         </nova:port>
Nov 27 03:25:59 user nova-compute[75006]:       </nova:ports>
Nov 27 03:25:59 user nova-compute[75006]:     </nova:instance>
Nov 27 03:25:59 user nova-compute[75006]:   </metadata>
Nov 27 03:25:59 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:25:59 user nova-compute[75006]:     <system>
Nov 27 03:25:59 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:25:59 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:25:59 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:25:59 user nova-compute[75006]:       <entry name="serial">70a4bf10-12f0-4b99-baa2-53be7becbb21</entry>
Nov 27 03:25:59 user nova-compute[75006]:       <entry name="uuid">70a4bf10-12f0-4b99-baa2-53be7becbb21</entry>
Nov 27 03:25:59 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:25:59 user nova-compute[75006]:     </system>
Nov 27 03:25:59 user nova-compute[75006]:   </sysinfo>
Nov 27 03:25:59 user nova-compute[75006]:   <os>
Nov 27 03:25:59 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:25:59 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:25:59 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:25:59 user nova-compute[75006]:   </os>
Nov 27 03:25:59 user nova-compute[75006]:   <features>
Nov 27 03:25:59 user nova-compute[75006]:     <acpi/>
Nov 27 03:25:59 user nova-compute[75006]:     <apic/>
Nov 27 03:25:59 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:25:59 user nova-compute[75006]:   </features>
Nov 27 03:25:59 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:25:59 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:25:59 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:25:59 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:25:59 user nova-compute[75006]:   </clock>
Nov 27 03:25:59 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:25:59 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:25:59 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:25:59 user nova-compute[75006]:   </cpu>
Nov 27 03:25:59 user nova-compute[75006]:   <devices>
Nov 27 03:25:59 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:25:59 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:25:59 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk"/>
Nov 27 03:25:59 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:25:59 user nova-compute[75006]:     </disk>
Nov 27 03:25:59 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:25:59 user nova-compute[75006]:       <mac address="fa:16:3e:1a:de:2b"/>
Nov 27 03:25:59 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:25:59 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:25:59 user nova-compute[75006]:       <target dev="tap1f7e81ab-18"/>
Nov 27 03:25:59 user nova-compute[75006]:     </interface>
Nov 27 03:25:59 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:25:59 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/console.log" append="off"/>
Nov 27 03:25:59 user nova-compute[75006]:     </serial>
Nov 27 03:25:59 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:25:59 user nova-compute[75006]:     <video>
Nov 27 03:25:59 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:25:59 user nova-compute[75006]:     </video>
Nov 27 03:25:59 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:25:59 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:25:59 user nova-compute[75006]:     </rng>
Nov 27 03:25:59 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:25:59 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:25:59 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:25:59 user nova-compute[75006]:     </memballoon>
Nov 27 03:25:59 user nova-compute[75006]:   </devices>
Nov 27 03:25:59 user nova-compute[75006]: </domain>
Nov 27 03:25:59 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'trusted_certs' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.objects.base [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-fa384e8b-6d29-406d-8dcc-d60e6b3755d1 req-3d5874c5-b168-4880-b8dc-42336ef186ec service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa384e8b-6d29-406d-8dcc-d60e6b3755d1 req-3d5874c5-b168-4880-b8dc-42336ef186ec service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa384e8b-6d29-406d-8dcc-d60e6b3755d1 req-3d5874c5-b168-4880-b8dc-42336ef186ec service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa384e8b-6d29-406d-8dcc-d60e6b3755d1 req-3d5874c5-b168-4880-b8dc-42336ef186ec service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:25:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-fa384e8b-6d29-406d-8dcc-d60e6b3755d1 req-3d5874c5-b168-4880-b8dc-42336ef186ec service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:25:59 user nova-compute[75006]: WARNING nova.compute.manager [req-fa384e8b-6d29-406d-8dcc-d60e6b3755d1 req-3d5874c5-b168-4880-b8dc-42336ef186ec service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state active and task_state resize_migrating.
Nov 27 03:26:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Port 01db2ae6-9b70-456e-aaa3-ecec258c0a00 binding to destination host user is already ACTIVE {{(pid=75006) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Cannot resize image /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.objects.instance [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'migration_context' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.objects.base [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Object Instance<70a4bf10-12f0-4b99-baa2-53be7becbb21> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:24:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG os_vif [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f256d33d-da2b-5e53-ab9a-c99eba3c2511', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f7e81ab-18, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f7e81ab-18, col_values=(('qos', UUID('a125192b-1179-4332-b057-fbca812ec6db')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f7e81ab-18, col_values=(('external_ids', {'iface-id': '1f7e81ab-1878-407b-a8fe-02ea2918ff76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:de:2b', 'vm-uuid': '70a4bf10-12f0-4b99-baa2-53be7becbb21'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:00 user nova-compute[75006]: INFO os_vif [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18')
Nov 27 03:26:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquired lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Releasing lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG os_brick.utils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc36fc-4b8d-4b7f-84be-134734a6dcc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d0c1b-0a95-48bf-9e86-2af4283407ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d0bd3-b709-43db-a5fc-7873734797f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d0cc35-61c9-488f-9fb5-c1d844058007]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:01 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:26:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d429c9-83ff-45fa-a9b8-4ae3bd405858]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG os_brick.utils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-40bc4129-ce98-4be3-9a00-b00049c11fbd req-d870bd90-32c0-4ea9-bc92-deda7d7e4eef service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-40bc4129-ce98-4be3-9a00-b00049c11fbd req-d870bd90-32c0-4ea9-bc92-deda7d7e4eef service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-40bc4129-ce98-4be3-9a00-b00049c11fbd req-d870bd90-32c0-4ea9-bc92-deda7d7e4eef service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-40bc4129-ce98-4be3-9a00-b00049c11fbd req-d870bd90-32c0-4ea9-bc92-deda7d7e4eef service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-40bc4129-ce98-4be3-9a00-b00049c11fbd req-d870bd90-32c0-4ea9-bc92-deda7d7e4eef service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:02 user nova-compute[75006]: WARNING nova.compute.manager [req-40bc4129-ce98-4be3-9a00-b00049c11fbd req-d870bd90-32c0-4ea9-bc92-deda7d7e4eef service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state stopped and task_state powering-on.
Nov 27 03:26:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:26:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance rebooted successfully.
Nov 27 03:26:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-120b1616-a1cf-4ae1-8e79-bb92fc382d4e tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:26:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-b0c1a099-0385-408c-a945-63252b83f2ae req-b298a744-f069-4f06-ad58-ed5b1e83195f service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b0c1a099-0385-408c-a945-63252b83f2ae req-b298a744-f069-4f06-ad58-ed5b1e83195f service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b0c1a099-0385-408c-a945-63252b83f2ae req-b298a744-f069-4f06-ad58-ed5b1e83195f service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b0c1a099-0385-408c-a945-63252b83f2ae req-b298a744-f069-4f06-ad58-ed5b1e83195f service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-b0c1a099-0385-408c-a945-63252b83f2ae req-b298a744-f069-4f06-ad58-ed5b1e83195f service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:04 user nova-compute[75006]: WARNING nova.compute.manager [req-b0c1a099-0385-408c-a945-63252b83f2ae req-b298a744-f069-4f06-ad58-ed5b1e83195f service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state stopped and task_state powering-on.
Nov 27 03:26:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:26:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:26:06 user nova-compute[75006]: INFO nova.compute.claims [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Claim successful on node user
Nov 27 03:26:07 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:26:07 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:26:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:26:07 user nova-compute[75006]: INFO nova.virt.block_device [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Booting with volume d08e1724-9a2a-4d86-839f-7fbc4ada97a6 at /dev/vda
Nov 27 03:26:07 user nova-compute[75006]: DEBUG nova.policy [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6137e3924ecd4ab0b8e32ce4b16356b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '269fb90362cc4ec1a82ae32822e68947', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG os_brick.utils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb327429-5aab-4d64-b5af-749dc919c04b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[603b3613-11ed-455f-ac1c-5cbdf0a6fcb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0a7760-11b8-4264-a985-2401d2293a38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6c07ef-1c5b-4f7a-9e7d-9e9966ddb3d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:07 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:26:07 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e518048-4c8b-4d9c-ae19-d5ed798f6564]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG os_brick.utils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:07 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating existing volume attachment record: 13a642f0-67db-45cc-94e2-904c70e68d7f {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully created port: d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Starting finish_migration {{(pid=75006) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance directory exists: not creating {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 03:26:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Creating image(s)
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk. size=21474836480 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully created port: e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk 21474836480 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk 21474836480" returned: 0 in 0.050s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Ensure instance console log exists: /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Start _get_guest_xml network_info=[{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-805329585-network", "vif_mac": "fa:16:3e:d9:f7:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '9db19837-c64c-4fef-82d6-eec4edebbd83', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e8860f63-c6ce-43ee-8c6e-6eea89d901d1', 'attached_at': '2023-11-27T03:26:08.000000', 'detached_at': '', 'volume_id': 'be037b90-f73b-4a57-a875-6944371554e7', 'serial': 'be037b90-f73b-4a57-a875-6944371554e7'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:26:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:26:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:09 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:26:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4921430a-67cc-418f-932f-c7249c8d2b31 is timed out.
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Successfully detached device vdc from instance 4921430a-67cc-418f-932f-c7249c8d2b31 from the live domain config.
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irKymaek', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b361a6a-7b39-4e3e-a393-4a0640824d05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:26:09 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[038713c5-8fb8-4375-b70c-684b7b8e0d09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7] added
Nov 27 03:26:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f421466-e905-4bf5-967e-deab7f926a1a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d606c4-e48c-42a0-a0b5-e019f8cc23ff]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqFPOaxz {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqFPOaxz" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dab4a1-1359-43a5-a6c6-c8179f7f1701]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqFPOaxz'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[deac20d5-5e22-445a-bf16-d039c7fc1df4]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8478ade4-abfc-41ef-82af-5e6ef0badd11]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b953d1a-a374-4637-8144-6ea1c7f34387]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]
Nov 27 03:26:09 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.
Nov 27 03:26:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[247678f8-4e9d-42c5-b644-ac586797f818]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f942e768-b2c7-4b45-9138-d9d963bf9b8e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.036s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9705fddf-7e64-4191-bd7b-0c8810028649]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully created port: 94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully created port: b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23938326433366139', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326433366139', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.354s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-805329585-network", "vif_mac": "fa:16:3e:d9:f7:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-805329585-network", "vif_mac": "fa:16:3e:d9:f7:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:26:10 user nova-compute[75006]:   <uuid>e8860f63-c6ce-43ee-8c6e-6eea89d901d1</uuid>
Nov 27 03:26:10 user nova-compute[75006]:   <name>instance-00000011</name>
Nov 27 03:26:10 user nova-compute[75006]:   <memory>2097152</memory>
Nov 27 03:26:10 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:26:10 user nova-compute[75006]:   <metadata>
Nov 27 03:26:10 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:26:10 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:26:10 user nova-compute[75006]:       <nova:name>tempest-ServerActionsTestOtherB-server-908294320</nova:name>
Nov 27 03:26:10 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:26:09</nova:creationTime>
Nov 27 03:26:10 user nova-compute[75006]:       <nova:flavor name="m1.small">
Nov 27 03:26:10 user nova-compute[75006]:         <nova:memory>2048</nova:memory>
Nov 27 03:26:10 user nova-compute[75006]:         <nova:disk>20</nova:disk>
Nov 27 03:26:10 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:26:10 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:26:10 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:26:10 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:26:10 user nova-compute[75006]:       <nova:owner>
Nov 27 03:26:10 user nova-compute[75006]:         <nova:user uuid="8df2fba5f3724b2fb210eef7331a2dcd">tempest-ServerActionsTestOtherB-1115240976-project-member</nova:user>
Nov 27 03:26:10 user nova-compute[75006]:         <nova:project uuid="00ce3c8acb7748f8af5dce8fc3f02ebe">tempest-ServerActionsTestOtherB-1115240976</nova:project>
Nov 27 03:26:10 user nova-compute[75006]:       </nova:owner>
Nov 27 03:26:10 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:26:10 user nova-compute[75006]:       <nova:ports>
Nov 27 03:26:10 user nova-compute[75006]:         <nova:port uuid="01db2ae6-9b70-456e-aaa3-ecec258c0a00">
Nov 27 03:26:10 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 03:26:10 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:10 user nova-compute[75006]:       </nova:ports>
Nov 27 03:26:10 user nova-compute[75006]:     </nova:instance>
Nov 27 03:26:10 user nova-compute[75006]:   </metadata>
Nov 27 03:26:10 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:26:10 user nova-compute[75006]:     <system>
Nov 27 03:26:10 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:26:10 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:26:10 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:26:10 user nova-compute[75006]:       <entry name="serial">e8860f63-c6ce-43ee-8c6e-6eea89d901d1</entry>
Nov 27 03:26:10 user nova-compute[75006]:       <entry name="uuid">e8860f63-c6ce-43ee-8c6e-6eea89d901d1</entry>
Nov 27 03:26:10 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:26:10 user nova-compute[75006]:     </system>
Nov 27 03:26:10 user nova-compute[75006]:   </sysinfo>
Nov 27 03:26:10 user nova-compute[75006]:   <os>
Nov 27 03:26:10 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:26:10 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:26:10 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:26:10 user nova-compute[75006]:   </os>
Nov 27 03:26:10 user nova-compute[75006]:   <features>
Nov 27 03:26:10 user nova-compute[75006]:     <acpi/>
Nov 27 03:26:10 user nova-compute[75006]:     <apic/>
Nov 27 03:26:10 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:26:10 user nova-compute[75006]:   </features>
Nov 27 03:26:10 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:26:10 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:26:10 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:26:10 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:26:10 user nova-compute[75006]:   </clock>
Nov 27 03:26:10 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:26:10 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:26:10 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:26:10 user nova-compute[75006]:   </cpu>
Nov 27 03:26:10 user nova-compute[75006]:   <devices>
Nov 27 03:26:10 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:26:10 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:26:10 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk"/>
Nov 27 03:26:10 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:26:10 user nova-compute[75006]:     </disk>
Nov 27 03:26:10 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:26:10 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:10 user nova-compute[75006]:       <source dev="/dev/sdd"/>
Nov 27 03:26:10 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:26:10 user nova-compute[75006]:       <serial>be037b90-f73b-4a57-a875-6944371554e7</serial>
Nov 27 03:26:10 user nova-compute[75006]:     </disk>
Nov 27 03:26:10 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:10 user nova-compute[75006]:       <mac address="fa:16:3e:d9:f7:5f"/>
Nov 27 03:26:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:10 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:10 user nova-compute[75006]:       <target dev="tap01db2ae6-9b"/>
Nov 27 03:26:10 user nova-compute[75006]:     </interface>
Nov 27 03:26:10 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:26:10 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/console.log" append="off"/>
Nov 27 03:26:10 user nova-compute[75006]:     </serial>
Nov 27 03:26:10 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:26:10 user nova-compute[75006]:     <video>
Nov 27 03:26:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:10 user nova-compute[75006]:     </video>
Nov 27 03:26:10 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:26:10 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:26:10 user nova-compute[75006]:     </rng>
Nov 27 03:26:10 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:26:10 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:26:10 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:26:10 user nova-compute[75006]:     </memballoon>
Nov 27 03:26:10 user nova-compute[75006]:   </devices>
Nov 27 03:26:10 user nova-compute[75006]: </domain>
Nov 27 03:26:10 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-805329585-network", "vif_mac": "fa:16:3e:d9:f7:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-805329585-network", "vif_mac": "fa:16:3e:d9:f7:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_vif [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed9d0e6-1c8c-4949-9033-eb7b2458fbff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:26:10 user nova-compute[75006]: No targets found.
Nov 27 03:26:10 user nova-compute[75006]: iSNS:
Nov 27 03:26:10 user nova-compute[75006]: No targets found.
Nov 27 03:26:10 user nova-compute[75006]: STATIC:
Nov 27 03:26:10 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8
Nov 27 03:26:10 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:26:10 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:26:10 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842
Nov 27 03:26:10 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:26:10 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:26:10 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:26:10 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:26:10 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:26:10 user nova-compute[75006]: FIRMWARE:
Nov 27 03:26:10 user nova-compute[75006]: No targets found.
Nov 27 03:26:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:26:10 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:26:10 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f161893-a824-536b-aad9-9d3fcc9391d0', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01db2ae6-9b, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01db2ae6-9b, col_values=(('qos', UUID('61f43703-7831-4939-872d-3d4da56a9af0')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01db2ae6-9b, col_values=(('external_ids', {'iface-id': '01db2ae6-9b70-456e-aaa3-ecec258c0a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:f7:5f', 'vm-uuid': 'e8860f63-c6ce-43ee-8c6e-6eea89d901d1'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[091c6d5f-0151-484c-b9a7-9f6407996b7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:10 user nova-compute[75006]: INFO os_vif [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b')
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef688227-52a8-444d-b89c-d0c52fd7f72a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:10 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:26:10 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:10 user nova-compute[75006]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 (non-flash)
Nov 27 03:26:10 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd448288040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8'): ({'sdc'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Removing single pathed devices sdc {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4337e9c0-e68a-4cae-bc5d-220ff34a70d8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] No VIF found with MAC fa:16:3e:d9:f7:5f, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.047s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[348a60d1-b579-490c-bccf-5609b8dfcca5]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Flushing IO for device /dev/sdc {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ac163a-7e4a-4427-9c58-f913acbdba34]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc02d0cd-f1ac-4f79-9cb9-f7fec556a863]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc676e37-dbbb-4ca9-a55b-731970d30460]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully created port: 2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81ba8a8-aa9c-445c-b85c-c0fdeebe96b1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8, portal: 172.16.0.220,3260]
Nov 27 03:26:10 user nova-compute[75006]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8, portal: 172.16.0.220,3260] successful.
Nov 27 03:26:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc678f1-d215-4adf-ae2f-438025951cb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[718caf7e-1fd1-471c-9311-133946900524]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] <== disconnect_volume: return (1719ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:26:11 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully updated port: d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:26:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-ac72ebdc-620d-45aa-a359-da9c8a1de96c req-5408bbf0-e202-478f-bde2-7ef93d61c78d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-changed-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-ac72ebdc-620d-45aa-a359-da9c8a1de96c req-5408bbf0-e202-478f-bde2-7ef93d61c78d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing instance network info cache due to event network-changed-d4cdffc5-8802-415c-8293-2371f9193bbf. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ac72ebdc-620d-45aa-a359-da9c8a1de96c req-5408bbf0-e202-478f-bde2-7ef93d61c78d service nova] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ac72ebdc-620d-45aa-a359-da9c8a1de96c req-5408bbf0-e202-478f-bde2-7ef93d61c78d service nova] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:11 user nova-compute[75006]: DEBUG nova.network.neutron [req-ac72ebdc-620d-45aa-a359-da9c8a1de96c req-5408bbf0-e202-478f-bde2-7ef93d61c78d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing network info cache for port d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:11 user nova-compute[75006]: DEBUG nova.network.neutron [req-ac72ebdc-620d-45aa-a359-da9c8a1de96c req-5408bbf0-e202-478f-bde2-7ef93d61c78d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:26:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully updated port: ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-ac72ebdc-620d-45aa-a359-da9c8a1de96c req-5408bbf0-e202-478f-bde2-7ef93d61c78d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ac72ebdc-620d-45aa-a359-da9c8a1de96c req-5408bbf0-e202-478f-bde2-7ef93d61c78d service nova] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-4a726ab8-d36a-4c64-975b-58c2866a0c7f req-607dde72-b034-4c2b-a191-48c02908d15f service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4a726ab8-d36a-4c64-975b-58c2866a0c7f req-607dde72-b034-4c2b-a191-48c02908d15f service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4a726ab8-d36a-4c64-975b-58c2866a0c7f req-607dde72-b034-4c2b-a191-48c02908d15f service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4a726ab8-d36a-4c64-975b-58c2866a0c7f req-607dde72-b034-4c2b-a191-48c02908d15f service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-4a726ab8-d36a-4c64-975b-58c2866a0c7f req-607dde72-b034-4c2b-a191-48c02908d15f service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:12 user nova-compute[75006]: WARNING nova.compute.manager [req-4a726ab8-d36a-4c64-975b-58c2866a0c7f req-607dde72-b034-4c2b-a191-48c02908d15f service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state active and task_state resize_finish.
Nov 27 03:26:13 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lazy-loading 'flavor' on Instance uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8ae1a2fa-bf48-4f8a-bff8-192ecf6f616a tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.563s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully updated port: d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:26:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-changed-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing instance network info cache due to event network-changed-ee7d4323-4c9b-42d1-b241-9808f3c8b240. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing network info cache for port ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.network.neutron [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully updated port: e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.network.neutron [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-changed-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing instance network info cache due to event network-changed-d140bf5e-3fda-494d-b8ed-e31c881b312a. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.network.neutron [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing network info cache for port d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.network.neutron [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:26:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance running successfully.
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Failed to set time: agent not configured {{(pid=75006) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e41f8c0a-5e9e-4a49-aef7-0146c0421f68 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] finish_migration finished successfully. {{(pid=75006) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.network.neutron [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76d59e16-30c0-449c-8fb1-ff5d7089d163 req-a73a5361-f0ba-4b6f-aa12-8f4f6fcfb27f service nova] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:14 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully updated port: 94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-d0a42388-43b2-4829-a345-c77c2428b029 req-19b22a4f-4e61-4111-b4a5-3aee98654c0a service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d0a42388-43b2-4829-a345-c77c2428b029 req-19b22a4f-4e61-4111-b4a5-3aee98654c0a service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d0a42388-43b2-4829-a345-c77c2428b029 req-19b22a4f-4e61-4111-b4a5-3aee98654c0a service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d0a42388-43b2-4829-a345-c77c2428b029 req-19b22a4f-4e61-4111-b4a5-3aee98654c0a service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-d0a42388-43b2-4829-a345-c77c2428b029 req-19b22a4f-4e61-4111-b4a5-3aee98654c0a service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:15 user nova-compute[75006]: WARNING nova.compute.manager [req-d0a42388-43b2-4829-a345-c77c2428b029 req-19b22a4f-4e61-4111-b4a5-3aee98654c0a service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state resized and task_state None.
Nov 27 03:26:15 user nova-compute[75006]: INFO nova.virt.block_device [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Booting with volume dd20e76b-1827-489f-ade1-365b9f092431 at /dev/vdb
Nov 27 03:26:15 user nova-compute[75006]: DEBUG os_brick.utils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[130fd302-37de-4c88-a383-bc9fb754af55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[97920200-b83a-4ac7-828f-bbfd2ce63392]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e9d93-ec41-4055-8f61-a19cc72c87b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8242da5f-f95f-4ad6-9090-3cdca9a5c799]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully updated port: b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:15 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee5644-6d40-4fa5-a60a-faff9980bd74]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG os_brick.utils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating existing volume attachment record: 707c0a7c-58c5-4e78-8ff8-7479f3354eac {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-changed-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing instance network info cache due to event network-changed-e4992f7c-e771-4a2d-ab98-d4043b69cd97. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:15 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing network info cache for port e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Successfully updated port: 2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-changed-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing instance network info cache due to event network-changed-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing network info cache for port 94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-changed-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing instance network info cache due to event network-changed-b807cd5a-c23e-4080-b147-fbf84168cfb5. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing network info cache for port b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:26:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-afa5a66c-3145-4c5a-a430-839b551fe974 req-25a005d3-332d-4177-9fa6-cdd9b33c7b72 service nova] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:17 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:26:17 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:26:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-ce869e29-81b8-4d94-8fe3-19b0711be4ea req-306e1bdb-e2c0-4630-b4eb-749e3dfda47d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-changed-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-ce869e29-81b8-4d94-8fe3-19b0711be4ea req-306e1bdb-e2c0-4630-b4eb-749e3dfda47d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing instance network info cache due to event network-changed-2c7037c4-0933-4be0-a140-616e09b84689. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ce869e29-81b8-4d94-8fe3-19b0711be4ea req-306e1bdb-e2c0-4630-b4eb-749e3dfda47d service nova] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [{"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance network_info: |[{"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ce869e29-81b8-4d94-8fe3-19b0711be4ea req-306e1bdb-e2c0-4630-b4eb-749e3dfda47d service nova] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-ce869e29-81b8-4d94-8fe3-19b0711be4ea req-306e1bdb-e2c0-4630-b4eb-749e3dfda47d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing network info cache for port 2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-ce869e29-81b8-4d94-8fe3-19b0711be4ea req-306e1bdb-e2c0-4630-b4eb-749e3dfda47d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updated VIF entry in instance network info cache for port 2c7037c4-0933-4be0-a140-616e09b84689. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-ce869e29-81b8-4d94-8fe3-19b0711be4ea req-306e1bdb-e2c0-4630-b4eb-749e3dfda47d service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [{"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ce869e29-81b8-4d94-8fe3-19b0711be4ea req-306e1bdb-e2c0-4630-b4eb-749e3dfda47d service nova] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-f1660061-3211-415f-9445-3b4d98ac5da5 req-4a86057f-61e4-4a1c-a035-3b5365dbad0a service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received event network-changed-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-f1660061-3211-415f-9445-3b4d98ac5da5 req-4a86057f-61e4-4a1c-a035-3b5365dbad0a service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Refreshing instance network info cache due to event network-changed-211dc942-48f1-40b2-8deb-99e87eaee687. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f1660061-3211-415f-9445-3b4d98ac5da5 req-4a86057f-61e4-4a1c-a035-3b5365dbad0a service nova] Acquiring lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f1660061-3211-415f-9445-3b4d98ac5da5 req-4a86057f-61e4-4a1c-a035-3b5365dbad0a service nova] Acquired lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:21 user nova-compute[75006]: DEBUG nova.network.neutron [req-f1660061-3211-415f-9445-3b4d98ac5da5 req-4a86057f-61e4-4a1c-a035-3b5365dbad0a service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Refreshing network info cache for port 211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:21 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'flavor' on Instance uuid b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Ignoring supplied device name: /dev/vdb
Nov 27 03:26:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG nova.network.neutron [req-f1660061-3211-415f-9445-3b4d98ac5da5 req-4a86057f-61e4-4a1c-a035-3b5365dbad0a service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Updated VIF entry in instance network info cache for port 211dc942-48f1-40b2-8deb-99e87eaee687. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG nova.network.neutron [req-f1660061-3211-415f-9445-3b4d98ac5da5 req-4a86057f-61e4-4a1c-a035-3b5365dbad0a service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Updating instance_info_cache with network_info: [{"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f1660061-3211-415f-9445-3b4d98ac5da5 req-4a86057f-61e4-4a1c-a035-3b5365dbad0a service nova] Releasing lock "refresh_cache-b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:22 user nova-compute[75006]: INFO nova.compute.manager [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Attaching volume d5aa874e-47a6-41ad-9514-fa5c287f8845 to /dev/vdb
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.utils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0ca71-f2f0-4b41-90ee-709ddbec7d9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd0db04-a114-4574-9515-516b3cde934c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[09647569-3aa6-47fc-8b0e-01726b590a26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: INFO nova.virt.block_device [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Booting with volume 42f43345-0e32-430e-b186-d3bfb8d8a5bb at /dev/vdc
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada9599f-481a-4ca2-a0a8-eee78458641e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:22 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bac8e2-861b-4cb4-86d9-ede8d899e497]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.utils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Updating existing volume attachment record: e1748e4f-ad0c-46d1-b148-537688f3c59f {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.utils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a68f1e0-e7d2-43b3-b4ce-83abffae4c94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44a1a5d-b1d3-4686-8a14-acae7f2fefc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[224ada2f-e50d-43ca-b914-6f1e4c136d2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bacea1-6abf-47d1-82af-8e75cd0b7744]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:22 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:26:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[109edf97-59ba-415e-93ee-3a5882eac160]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG os_brick.utils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:22 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating existing volume attachment record: 7605b6f9-5490-47ce-96fa-b0078faa7d02 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:26:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-c3458661-94f2-4095-8937-37d440108d58 req-2fc63e00-47fd-4bbf-8c79-52c7c37248f6 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received event network-changed-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-c3458661-94f2-4095-8937-37d440108d58 req-2fc63e00-47fd-4bbf-8c79-52c7c37248f6 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Refreshing instance network info cache due to event network-changed-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c3458661-94f2-4095-8937-37d440108d58 req-2fc63e00-47fd-4bbf-8c79-52c7c37248f6 service nova] Acquiring lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c3458661-94f2-4095-8937-37d440108d58 req-2fc63e00-47fd-4bbf-8c79-52c7c37248f6 service nova] Acquired lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:25 user nova-compute[75006]: DEBUG nova.network.neutron [req-c3458661-94f2-4095-8937-37d440108d58 req-2fc63e00-47fd-4bbf-8c79-52c7c37248f6 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Refreshing network info cache for port aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:26 user nova-compute[75006]: DEBUG nova.network.neutron [req-c3458661-94f2-4095-8937-37d440108d58 req-2fc63e00-47fd-4bbf-8c79-52c7c37248f6 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Updated VIF entry in instance network info cache for port aaa662b2-e109-4a0a-9d8d-2d6e2734dfec. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:26:26 user nova-compute[75006]: DEBUG nova.network.neutron [req-c3458661-94f2-4095-8937-37d440108d58 req-2fc63e00-47fd-4bbf-8c79-52c7c37248f6 service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Updating instance_info_cache with network_info: [{"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c3458661-94f2-4095-8937-37d440108d58 req-2fc63e00-47fd-4bbf-8c79-52c7c37248f6 service nova] Releasing lock "refresh_cache-b90e98c7-3949-4b69-80c7-2a5b85bc88a3" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG nova.objects.instance [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid b90e98c7-3949-4b69-80c7-2a5b85bc88a3 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:28 user nova-compute[75006]: INFO nova.compute.manager [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Attaching volume 6b2699ff-bb36-497a-bc1c-835c889dc691 to /dev/vdb
Nov 27 03:26:28 user nova-compute[75006]: DEBUG os_brick.utils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c3738d-4beb-4d07-9a89-26b644d35b78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[441afa94-1372-4663-a3c0-2c0a65d73aa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d89e25-8d29-493c-97bc-813d9951a8aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[62274c50-9196-4b46-a099-a189b654ed5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:28 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:26:28 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63005be-01b5-41e2-86a5-296e3c51f47d]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG os_brick.utils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:28 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Updating existing volume attachment record: adfcd96e-86f2-457e-85e7-c0770558b67c {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:26:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:26:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Creating image(s)
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Ensure instance console log exists: /opt/stack/data/nova/instances/90630ecf-9ed5-47cc-b7b9-b313ed57e46f/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Start _get_guest_xml network_info=[{"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '13a642f0-67db-45cc-94e2-904c70e68d7f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrWGzYcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd08e1724-9a2a-4d86-839f-7fbc4ada97a6', 'serial': 'd08e1724-9a2a-4d86-839f-7fbc4ada97a6'}, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '707c0a7c-58c5-4e78-8ff8-7479f3354eac', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSgBZMjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd20e76b-1827-489f-ade1-365b9f092431', 'serial': 'dd20e76b-1827-489f-ade1-365b9f092431'}, 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '7605b6f9-5490-47ce-96fa-b0078faa7d02', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkBYSePr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f', 'attached_at': '', 'detached_at': '', 'volume_id': '42f43345-0e32-430e-b186-d3bfb8d8a5bb', 'serial': '42f43345-0e32-430e-b186-d3bfb8d8a5bb'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:26:30 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:26:30 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrWGzYcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:30 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:30 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:30 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63f8e9f-3e28-40b3-b40f-ccfa3ae57de6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:26:30 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8399dc56-8240-4acc-943d-a0bcbc0c7110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6] added
Nov 27 03:26:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3578bcff-0056-471c-b6d5-06c0834097b7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[94434c1c-e682-4a9a-8af4-3023339b79a8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IrWGzYcq {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IrWGzYcq" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[92341e5c-4a0a-4616-b04c-d8515fe03006]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IrWGzYcq'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bfe9da-c026-4c8d-b75c-0a8265e1db98]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[659ed9fd-49a9-4764-bd98-69ce059b2629]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:30 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:30 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d1307-6a1b-4ccf-8e3c-f53deb44afaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6, portal: 172.16.0.220,3260]
Nov 27 03:26:30 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6, portal: 172.16.0.220,3260] successful.
Nov 27 03:26:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c62fe-5ace-4225-8e24-c8f667f50f9d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13a84fa-7ed7-4e51-9d22-1c9b9b6c9c0b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:31 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:31 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:31 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:31 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[512a8bb1-0690-4518-9c2f-82bd21791c82]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:26:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrWGzYcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26362343333383732', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362343333383732', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSgBZMjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:32 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f100d55-023e-47b0-aa7c-3ab0212b351c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:26:32 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5da3eb6-8433-4be9-8c01-746b7295c127]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431] added
Nov 27 03:26:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d9f292-fe73-40cb-be0d-84092c9e36d3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb4c6f-b43a-4b4c-9844-a912363f6307]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSgBZMjb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSgBZMjb" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5127508e-5588-4275-92d5-11f3554f0d41]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qSgBZMjb'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf5e846-32fd-470f-937e-a0688115c1f2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e309140c-7e94-4ab7-add4-d8af5fb77085]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bd027c-8bfd-4820-b2f5-70c1a3f2dcca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431, portal: 172.16.0.220,3260]
Nov 27 03:26:32 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431, portal: 172.16.0.220,3260] successful.
Nov 27 03:26:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d9e67-7702-4b54-a238-c2c2870f2380]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf15e42a-20d7-4a44-a986-6ce51a43d852]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3601a0-343b-4864-8107-546748879a99]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSgBZMjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23132396366613937', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132396366613937', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkBYSePr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:33 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:33 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:33 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fdb950-c64a-43de-8d95-e8f1af93d7d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:26:33 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e89953-9a07-4eab-9463-281815ab4a8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb] added
Nov 27 03:26:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1191b59f-d719-406b-b957-a9da6b8bab92]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e6fb0-a624-4f71-9286-e3f11811893f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkBYSePr {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkBYSePr" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ef498f-4cc7-44ed-97b5-e76475e24dab]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UkBYSePr'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f519ab9-b34c-4cee-86a3-1b45993ab003]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[570fa859-5134-4dd7-a000-6f099c901630]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b300f8e9-7e26-4054-a16f-3f47904fe85f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb, portal: 172.16.0.220,3260]
Nov 27 03:26:33 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb, portal: 172.16.0.220,3260] successful.
Nov 27 03:26:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf7a39b-475e-422c-add3-4b0e20f97e5a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb74e2-0e60-48d3-814a-ef83ff0b5c05]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:33 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ca8aab-0731-4711-8e49-5394a34d4495]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:26:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkBYSePr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26566303530303733', 'path': '/dev/sdf'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566303530303733', 'path': '/dev/sdf'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:50:c5,bridge_name='br-int',has_traffic_filtering=True,id=d4cdffc5-8802-415c-8293-2371f9193bbf,network=Network(b58701d4-1e20-4660-a02f-5169914f6dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cdffc5-88') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:31,bridge_name='br-int',has_traffic_filtering=True,id=ee7d4323-4c9b-42d1-b241-9808f3c8b240,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee7d4323-4c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c6:2e,bridge_name='br-int',has_traffic_filtering=True,id=d140bf5e-3fda-494d-b8ed-e31c881b312a,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd140bf5e-3f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:75:94,bridge_name='br-int',has_traffic_filtering=True,id=e4992f7c-e771-4a2d-ab98-d4043b69cd97,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4992f7c-e7') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:22,bridge_name='br-int',has_traffic_filtering=True,id=94a4e019-508f-4a0c-aabb-9f71f7e9b8b2,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a4e019-50') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c7:75,bridge_name='br-int',has_traffic_filtering=True,id=b807cd5a-c23e-4080-b147-fbf84168cfb5,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb807cd5a-c2') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:60:20,bridge_name='br-int',has_traffic_filtering=True,id=2c7037c4-0933-4be0-a140-616e09b84689,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7037c4-09') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.objects.instance [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lazy-loading 'pci_devices' on Instance uuid 90630ecf-9ed5-47cc-b7b9-b313ed57e46f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:26:34 user nova-compute[75006]:   <uuid>90630ecf-9ed5-47cc-b7b9-b313ed57e46f</uuid>
Nov 27 03:26:34 user nova-compute[75006]:   <name>instance-00000019</name>
Nov 27 03:26:34 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:26:34 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:26:34 user nova-compute[75006]:   <metadata>
Nov 27 03:26:34 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:26:34 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:26:34 user nova-compute[75006]:       <nova:name>tempest-device-tagging-server-169740551</nova:name>
Nov 27 03:26:34 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:26:30</nova:creationTime>
Nov 27 03:26:34 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:26:34 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:26:34 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:26:34 user nova-compute[75006]:       <nova:owner>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:user uuid="6137e3924ecd4ab0b8e32ce4b16356b0">tempest-TaggedBootDevicesTest-243315587-project-member</nova:user>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:project uuid="269fb90362cc4ec1a82ae32822e68947">tempest-TaggedBootDevicesTest-243315587</nova:project>
Nov 27 03:26:34 user nova-compute[75006]:       </nova:owner>
Nov 27 03:26:34 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:26:34 user nova-compute[75006]:       <nova:ports>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:port uuid="d4cdffc5-8802-415c-8293-2371f9193bbf">
Nov 27 03:26:34 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 03:26:34 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:port uuid="ee7d4323-4c9b-42d1-b241-9808f3c8b240">
Nov 27 03:26:34 user nova-compute[75006]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Nov 27 03:26:34 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:port uuid="d140bf5e-3fda-494d-b8ed-e31c881b312a">
Nov 27 03:26:34 user nova-compute[75006]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Nov 27 03:26:34 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:port uuid="e4992f7c-e771-4a2d-ab98-d4043b69cd97">
Nov 27 03:26:34 user nova-compute[75006]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Nov 27 03:26:34 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:port uuid="94a4e019-508f-4a0c-aabb-9f71f7e9b8b2">
Nov 27 03:26:34 user nova-compute[75006]:           <nova:ip type="fixed" address="10.1.1.184" ipVersion="4"/>
Nov 27 03:26:34 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:port uuid="b807cd5a-c23e-4080-b147-fbf84168cfb5">
Nov 27 03:26:34 user nova-compute[75006]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 27 03:26:34 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:34 user nova-compute[75006]:         <nova:port uuid="2c7037c4-0933-4be0-a140-616e09b84689">
Nov 27 03:26:34 user nova-compute[75006]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 27 03:26:34 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:34 user nova-compute[75006]:       </nova:ports>
Nov 27 03:26:34 user nova-compute[75006]:     </nova:instance>
Nov 27 03:26:34 user nova-compute[75006]:   </metadata>
Nov 27 03:26:34 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:26:34 user nova-compute[75006]:     <system>
Nov 27 03:26:34 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:26:34 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:26:34 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:26:34 user nova-compute[75006]:       <entry name="serial">90630ecf-9ed5-47cc-b7b9-b313ed57e46f</entry>
Nov 27 03:26:34 user nova-compute[75006]:       <entry name="uuid">90630ecf-9ed5-47cc-b7b9-b313ed57e46f</entry>
Nov 27 03:26:34 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:26:34 user nova-compute[75006]:     </system>
Nov 27 03:26:34 user nova-compute[75006]:   </sysinfo>
Nov 27 03:26:34 user nova-compute[75006]:   <os>
Nov 27 03:26:34 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:26:34 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:26:34 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:26:34 user nova-compute[75006]:   </os>
Nov 27 03:26:34 user nova-compute[75006]:   <features>
Nov 27 03:26:34 user nova-compute[75006]:     <acpi/>
Nov 27 03:26:34 user nova-compute[75006]:     <apic/>
Nov 27 03:26:34 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:26:34 user nova-compute[75006]:   </features>
Nov 27 03:26:34 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:26:34 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:26:34 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:26:34 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:26:34 user nova-compute[75006]:   </clock>
Nov 27 03:26:34 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:26:34 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:26:34 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:26:34 user nova-compute[75006]:   </cpu>
Nov 27 03:26:34 user nova-compute[75006]:   <devices>
Nov 27 03:26:34 user nova-compute[75006]:     <disk type="file" device="cdrom">
Nov 27 03:26:34 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 03:26:34 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/90630ecf-9ed5-47cc-b7b9-b313ed57e46f/disk.config"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="hda" bus="ide"/>
Nov 27 03:26:34 user nova-compute[75006]:     </disk>
Nov 27 03:26:34 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:26:34 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:34 user nova-compute[75006]:       <source dev="/dev/sdc"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <serial>d08e1724-9a2a-4d86-839f-7fbc4ada97a6</serial>
Nov 27 03:26:34 user nova-compute[75006]:     </disk>
Nov 27 03:26:34 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:26:34 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:34 user nova-compute[75006]:       <source dev="/dev/sde"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <serial>dd20e76b-1827-489f-ade1-365b9f092431</serial>
Nov 27 03:26:34 user nova-compute[75006]:     </disk>
Nov 27 03:26:34 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:26:34 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:34 user nova-compute[75006]:       <source dev="/dev/sdf"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="vdc" bus="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <serial>42f43345-0e32-430e-b186-d3bfb8d8a5bb</serial>
Nov 27 03:26:34 user nova-compute[75006]:     </disk>
Nov 27 03:26:34 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:34 user nova-compute[75006]:       <mac address="fa:16:3e:46:50:c5"/>
Nov 27 03:26:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="tapd4cdffc5-88"/>
Nov 27 03:26:34 user nova-compute[75006]:     </interface>
Nov 27 03:26:34 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:34 user nova-compute[75006]:       <mac address="fa:16:3e:cc:e0:31"/>
Nov 27 03:26:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="tapee7d4323-4c"/>
Nov 27 03:26:34 user nova-compute[75006]:     </interface>
Nov 27 03:26:34 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:34 user nova-compute[75006]:       <mac address="fa:16:3e:b3:c6:2e"/>
Nov 27 03:26:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="tapd140bf5e-3f"/>
Nov 27 03:26:34 user nova-compute[75006]:     </interface>
Nov 27 03:26:34 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:34 user nova-compute[75006]:       <mac address="fa:16:3e:8d:75:94"/>
Nov 27 03:26:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="tape4992f7c-e7"/>
Nov 27 03:26:34 user nova-compute[75006]:     </interface>
Nov 27 03:26:34 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:34 user nova-compute[75006]:       <mac address="fa:16:3e:45:49:22"/>
Nov 27 03:26:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="tap94a4e019-50"/>
Nov 27 03:26:34 user nova-compute[75006]:     </interface>
Nov 27 03:26:34 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:34 user nova-compute[75006]:       <mac address="fa:16:3e:4e:c7:75"/>
Nov 27 03:26:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="tapb807cd5a-c2"/>
Nov 27 03:26:34 user nova-compute[75006]:     </interface>
Nov 27 03:26:34 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:34 user nova-compute[75006]:       <mac address="fa:16:3e:c0:60:20"/>
Nov 27 03:26:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:34 user nova-compute[75006]:       <target dev="tap2c7037c4-09"/>
Nov 27 03:26:34 user nova-compute[75006]:     </interface>
Nov 27 03:26:34 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:26:34 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/90630ecf-9ed5-47cc-b7b9-b313ed57e46f/console.log" append="off"/>
Nov 27 03:26:34 user nova-compute[75006]:     </serial>
Nov 27 03:26:34 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:26:34 user nova-compute[75006]:     <video>
Nov 27 03:26:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:34 user nova-compute[75006]:     </video>
Nov 27 03:26:34 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:26:34 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:26:34 user nova-compute[75006]:     </rng>
Nov 27 03:26:34 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:26:34 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:26:34 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:26:34 user nova-compute[75006]:     </memballoon>
Nov 27 03:26:34 user nova-compute[75006]:   </devices>
Nov 27 03:26:34 user nova-compute[75006]: </domain>
Nov 27 03:26:34 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:50:c5,bridge_name='br-int',has_traffic_filtering=True,id=d4cdffc5-8802-415c-8293-2371f9193bbf,network=Network(b58701d4-1e20-4660-a02f-5169914f6dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cdffc5-88') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:50:c5,bridge_name='br-int',has_traffic_filtering=True,id=d4cdffc5-8802-415c-8293-2371f9193bbf,network=Network(b58701d4-1e20-4660-a02f-5169914f6dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cdffc5-88') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f118b51-49a5-5c27-82ba-100cede6cdad', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4cdffc5-88, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4cdffc5-88, col_values=(('qos', UUID('15a6cf7c-ad98-40a7-8640-07054ea7aba6')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4cdffc5-88, col_values=(('external_ids', {'iface-id': 'd4cdffc5-8802-415c-8293-2371f9193bbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:50:c5', 'vm-uuid': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: INFO os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:50:c5,bridge_name='br-int',has_traffic_filtering=True,id=d4cdffc5-8802-415c-8293-2371f9193bbf,network=Network(b58701d4-1e20-4660-a02f-5169914f6dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cdffc5-88')
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:31,bridge_name='br-int',has_traffic_filtering=True,id=ee7d4323-4c9b-42d1-b241-9808f3c8b240,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee7d4323-4c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:31,bridge_name='br-int',has_traffic_filtering=True,id=ee7d4323-4c9b-42d1-b241-9808f3c8b240,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee7d4323-4c') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afa7005d-c25d-59f4-ba8e-85f9fadc5274', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee7d4323-4c, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee7d4323-4c, col_values=(('qos', UUID('19b32d34-7923-46ba-8f10-986dfd09b802')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee7d4323-4c, col_values=(('external_ids', {'iface-id': 'ee7d4323-4c9b-42d1-b241-9808f3c8b240', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:e0:31', 'vm-uuid': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: INFO os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:31,bridge_name='br-int',has_traffic_filtering=True,id=ee7d4323-4c9b-42d1-b241-9808f3c8b240,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee7d4323-4c')
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c6:2e,bridge_name='br-int',has_traffic_filtering=True,id=d140bf5e-3fda-494d-b8ed-e31c881b312a,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd140bf5e-3f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c6:2e,bridge_name='br-int',has_traffic_filtering=True,id=d140bf5e-3fda-494d-b8ed-e31c881b312a,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd140bf5e-3f') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '854c1b13-fb7e-5c5b-9fd0-58ebe1016df5', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd140bf5e-3f, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd140bf5e-3f, col_values=(('qos', UUID('28a1e397-aec0-44c1-9420-57b5a3df8c70')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd140bf5e-3f, col_values=(('external_ids', {'iface-id': 'd140bf5e-3fda-494d-b8ed-e31c881b312a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:c6:2e', 'vm-uuid': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: INFO os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c6:2e,bridge_name='br-int',has_traffic_filtering=True,id=d140bf5e-3fda-494d-b8ed-e31c881b312a,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd140bf5e-3f')
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:75:94,bridge_name='br-int',has_traffic_filtering=True,id=e4992f7c-e771-4a2d-ab98-d4043b69cd97,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4992f7c-e7') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:75:94,bridge_name='br-int',has_traffic_filtering=True,id=e4992f7c-e771-4a2d-ab98-d4043b69cd97,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4992f7c-e7') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80a98c9d-2073-55c6-ad31-a31df272af1c', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4992f7c-e7, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4992f7c-e7, col_values=(('qos', UUID('de3a2f7e-1119-43a8-be6c-311a62e51511')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4992f7c-e7, col_values=(('external_ids', {'iface-id': 'e4992f7c-e771-4a2d-ab98-d4043b69cd97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:75:94', 'vm-uuid': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: INFO os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:75:94,bridge_name='br-int',has_traffic_filtering=True,id=e4992f7c-e771-4a2d-ab98-d4043b69cd97,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4992f7c-e7')
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:22,bridge_name='br-int',has_traffic_filtering=True,id=94a4e019-508f-4a0c-aabb-9f71f7e9b8b2,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a4e019-50') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:22,bridge_name='br-int',has_traffic_filtering=True,id=94a4e019-508f-4a0c-aabb-9f71f7e9b8b2,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a4e019-50') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '205a17ba-6dbf-51a2-923c-7ec1957dfd0a', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94a4e019-50, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94a4e019-50, col_values=(('qos', UUID('33f11da4-4915-43bf-af38-c74b65904a20')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94a4e019-50, col_values=(('external_ids', {'iface-id': '94a4e019-508f-4a0c-aabb-9f71f7e9b8b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:49:22', 'vm-uuid': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: INFO os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:22,bridge_name='br-int',has_traffic_filtering=True,id=94a4e019-508f-4a0c-aabb-9f71f7e9b8b2,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a4e019-50')
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c7:75,bridge_name='br-int',has_traffic_filtering=True,id=b807cd5a-c23e-4080-b147-fbf84168cfb5,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb807cd5a-c2') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c7:75,bridge_name='br-int',has_traffic_filtering=True,id=b807cd5a-c23e-4080-b147-fbf84168cfb5,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb807cd5a-c2') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b395cb83-2cdc-53fb-aec1-51195fece11f', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb807cd5a-c2, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb807cd5a-c2, col_values=(('qos', UUID('d6da1a58-9bcf-42ee-8ef7-c66f8699a99e')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb807cd5a-c2, col_values=(('external_ids', {'iface-id': 'b807cd5a-c23e-4080-b147-fbf84168cfb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:c7:75', 'vm-uuid': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: INFO os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c7:75,bridge_name='br-int',has_traffic_filtering=True,id=b807cd5a-c23e-4080-b147-fbf84168cfb5,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb807cd5a-c2')
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:60:20,bridge_name='br-int',has_traffic_filtering=True,id=2c7037c4-0933-4be0-a140-616e09b84689,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7037c4-09') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:60:20,bridge_name='br-int',has_traffic_filtering=True,id=2c7037c4-0933-4be0-a140-616e09b84689,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7037c4-09') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '218a1b79-0f31-53f9-a9d7-4ad279701e7a', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c7037c4-09, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c7037c4-09, col_values=(('qos', UUID('129e54f1-615c-4059-9b13-bc44ec1f9c74')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c7037c4-09, col_values=(('external_ids', {'iface-id': '2c7037c4-0933-4be0-a140-616e09b84689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:60:20', 'vm-uuid': '90630ecf-9ed5-47cc-b7b9-b313ed57e46f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:35 user nova-compute[75006]: INFO os_vif [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:60:20,bridge_name='br-int',has_traffic_filtering=True,id=2c7037c4-0933-4be0-a140-616e09b84689,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7037c4-09')
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] No BDM found with device name hda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] No VIF found with MAC fa:16:3e:46:50:c5, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] No VIF found with MAC fa:16:3e:45:49:22, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:26:35 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Using config drive
Nov 27 03:26:35 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Creating config drive at /opt/stack/data/nova/instances/90630ecf-9ed5-47cc-b7b9-b313ed57e46f/disk.config
Nov 27 03:26:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90630ecf-9ed5-47cc-b7b9-b313ed57e46f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps1mylodn {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90630ecf-9ed5-47cc-b7b9-b313ed57e46f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps1mylodn" returned: 0 in 0.056s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WraAoJxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:36 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:36 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:36 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d496412c-e6d5-4b92-a70e-4b018efea051]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:26:36 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WliGzhoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:36 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae6c3c-11fb-4491-a656-c258bd35c1bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845] added
Nov 27 03:26:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fcfcf5-d9af-4d49-90a6-910f5cbd1a84]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a468e9-c778-420b-a586-7d87f3624fe3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WraAoJxi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WraAoJxi" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2e15c9-ad96-4751-9353-0f8bc0605170]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WraAoJxi'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[02236677-fdeb-4d91-9b2f-637e8bdae5d9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf422aa1-50f7-4ef2-aeaa-234d34f1d590]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0a9de-d8f9-4404-a748-ad0ed88ca230]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845, portal: 172.16.0.220,3260]
Nov 27 03:26:36 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845, portal: 172.16.0.220,3260] successful.
Nov 27 03:26:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6467f87f-fab1-4e8f-a0fc-42e03d675cc8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[de98b086-8a59-47ce-96a1-6e4fc4d27558]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:36 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:36 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b01c73-8a0a-4496-81d5-6811baceff1f]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:26:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WraAoJxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "fd992ae2-0b97-47d2-9e03-f707af65f190" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:37 user nova-compute[75006]: INFO nova.compute.manager [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Terminating instance
Nov 27 03:26:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-45f640f7-4640-466d-aa59-98cebb22e063 req-5105547e-8b0c-4cba-b993-dd0a015eea1c service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-45f640f7-4640-466d-aa59-98cebb22e063 req-5105547e-8b0c-4cba-b993-dd0a015eea1c service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-45f640f7-4640-466d-aa59-98cebb22e063 req-5105547e-8b0c-4cba-b993-dd0a015eea1c service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-45f640f7-4640-466d-aa59-98cebb22e063 req-5105547e-8b0c-4cba-b993-dd0a015eea1c service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-45f640f7-4640-466d-aa59-98cebb22e063 req-5105547e-8b0c-4cba-b993-dd0a015eea1c service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:37 user nova-compute[75006]: WARNING nova.compute.manager [req-45f640f7-4640-466d-aa59-98cebb22e063 req-5105547e-8b0c-4cba-b993-dd0a015eea1c service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf for instance with vm_state building and task_state spawning.
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23530656462386463', 'path': '/dev/sdg'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530656462386463', 'path': '/dev/sdg'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.337s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:37 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:37 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'flavor' on Instance uuid b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d1bb58-7412-4740-ac01-0dc8084d93d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:26:37 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa217c7-bcae-48d7-8dc5-236234968ebc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:26:37 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:37 user nova-compute[75006]:   <source dev="/dev/sdg"/>
Nov 27 03:26:37 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:37 user nova-compute[75006]:   <serial>d5aa874e-47a6-41ad-9514-fa5c287f8845</serial>
Nov 27 03:26:37 user nova-compute[75006]: </disk>
Nov 27 03:26:37 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691] added
Nov 27 03:26:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dbe881-62e2-47f1-b707-9d054196086d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[da07d2c3-1169-4443-9c26-baec0e6e6fe0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WliGzhoX {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WliGzhoX" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6447f8bd-ee63-4dc5-8be1-bc8be5e3f47d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WliGzhoX'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad98c4f4-209e-4429-80f6-cff054a6c24b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bdbe37-59ee-4dd9-98f2-cd7aabc98ddd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f00bc1-b1f4-46b2-a883-e4f0860a979b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691, portal: 172.16.0.220,3260]
Nov 27 03:26:38 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691, portal: 172.16.0.220,3260] successful.
Nov 27 03:26:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ddddaf-a918-41f7-a83c-be5aaa967cfd]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-5133d79f-e958-40e9-837f-159a9ee04b45 req-18147d01-3cc4-4e1d-95d4-7a1b88f0ef37 service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received event network-vif-unplugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5133d79f-e958-40e9-837f-159a9ee04b45 req-18147d01-3cc4-4e1d-95d4-7a1b88f0ef37 service nova] Acquiring lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5133d79f-e958-40e9-837f-159a9ee04b45 req-18147d01-3cc4-4e1d-95d4-7a1b88f0ef37 service nova] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5133d79f-e958-40e9-837f-159a9ee04b45 req-18147d01-3cc4-4e1d-95d4-7a1b88f0ef37 service nova] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-5133d79f-e958-40e9-837f-159a9ee04b45 req-18147d01-3cc4-4e1d-95d4-7a1b88f0ef37 service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] No waiting events found dispatching network-vif-unplugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-5133d79f-e958-40e9-837f-159a9ee04b45 req-18147d01-3cc4-4e1d-95d4-7a1b88f0ef37 service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received event network-vif-unplugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec8fd2e-b61d-403a-9f4d-ef8a9cf18681]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:26:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] HCTL ('39', '-', '-', 0) found on session 28 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[152fc9b0-e97f-4cae-92be-c2a8f8091d6f]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching for a device in session 28 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WliGzhoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-933bee9a-bd9b-45e7-8c16-691a086381a6 req-c0f8ca16-a91c-4dd3-93c7-ab0eca591e63 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-933bee9a-bd9b-45e7-8c16-691a086381a6 req-c0f8ca16-a91c-4dd3-93c7-ab0eca591e63 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-933bee9a-bd9b-45e7-8c16-691a086381a6 req-c0f8ca16-a91c-4dd3-93c7-ab0eca591e63 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-933bee9a-bd9b-45e7-8c16-691a086381a6 req-c0f8ca16-a91c-4dd3-93c7-ab0eca591e63 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-933bee9a-bd9b-45e7-8c16-691a086381a6 req-c0f8ca16-a91c-4dd3-93c7-ab0eca591e63 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:38 user nova-compute[75006]: WARNING nova.compute.manager [req-933bee9a-bd9b-45e7-8c16-691a086381a6 req-c0f8ca16-a91c-4dd3-93c7-ab0eca591e63 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a for instance with vm_state building and task_state spawning.
Nov 27 03:26:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No VIF found with MAC fa:16:3e:3b:fd:19, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6737e0a1-2fb9-4f8b-9698-1faf96fd5c08 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.404s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Instance destroyed successfully.
Nov 27 03:26:38 user nova-compute[75006]: DEBUG nova.objects.instance [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lazy-loading 'resources' on Instance uuid fd992ae2-0b97-47d2-9e03-f707af65f190 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1303896564',display_name='tempest-ServersNegativeTestJSON-server-1303896564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1303896564',id=2,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ca85c0868b6468fb2a3025ccd562f91',ramdisk_id='',reservation_id='r-blaov2vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-809508397',owner_user_name='tempest-ServersNegativeTestJSON-809508397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:18:01Z,user_data=None,user_id='b5489e0f1a5c4bb1896c89ffaed79d77',uuid=fd992ae2-0b97-47d2-9e03-f707af65f190,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converting VIF {"id": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "address": "fa:16:3e:08:13:d4", "network": {"id": "5f201e62-c490-495c-8312-b2592e0a6288", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2119675360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ca85c0868b6468fb2a3025ccd562f91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac73c62b-63", "ovs_interfaceid": "ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:13:d4,bridge_name='br-int',has_traffic_filtering=True,id=ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac73c62b-63') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG os_vif [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:13:d4,bridge_name='br-int',has_traffic_filtering=True,id=ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac73c62b-63') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac73c62b-63, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b812794-c87f-4452-b809-5b810d7c0e3f) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: INFO os_vif [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:13:d4,bridge_name='br-int',has_traffic_filtering=True,id=ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b,network=Network(5f201e62-c490-495c-8312-b2592e0a6288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac73c62b-63')
Nov 27 03:26:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Deleting instance files /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190_del
Nov 27 03:26:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Deletion of /opt/stack/data/nova/instances/fd992ae2-0b97-47d2-9e03-f707af65f190_del complete
Nov 27 03:26:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== connect_volume: return (2809ms) {'type': 'block', 'scsi_wwn': '23131363863666434', 'path': '/dev/sdh'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131363863666434', 'path': '/dev/sdh'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:26:39 user nova-compute[75006]: INFO nova.compute.manager [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Took 1.68 seconds to destroy the instance on the hypervisor.
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.objects.instance [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid b90e98c7-3949-4b69-80c7-2a5b85bc88a3 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:39 user nova-compute[75006]: INFO nova.compute.manager [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Detaching volume bc2f8e73-674d-4ca3-a1a2-125d3948c842
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:26:39 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:39 user nova-compute[75006]:   <source dev="/dev/sdh"/>
Nov 27 03:26:39 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:39 user nova-compute[75006]:   <serial>6b2699ff-bb36-497a-bc1c-835c889dc691</serial>
Nov 27 03:26:39 user nova-compute[75006]: </disk>
Nov 27 03:26:39 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: INFO nova.virt.block_device [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Attempting to driver detach volume bc2f8e73-674d-4ca3-a1a2-125d3948c842 from mountpoint /dev/vdb
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Attempting to detach device vdb from instance 4921430a-67cc-418f-932f-c7249c8d2b31 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:26:39 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:39 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:26:39 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:39 user nova-compute[75006]:   <serial>bc2f8e73-674d-4ca3-a1a2-125d3948c842</serial>
Nov 27 03:26:39 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:26:39 user nova-compute[75006]: </disk>
Nov 27 03:26:39 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:26:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Successfully detached device vdb from instance 4921430a-67cc-418f-932f-c7249c8d2b31 from the persistent domain config.
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4921430a-67cc-418f-932f-c7249c8d2b31 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:26:39 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:39 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:26:39 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:39 user nova-compute[75006]:   <serial>bc2f8e73-674d-4ca3-a1a2-125d3948c842</serial>
Nov 27 03:26:39 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:26:39 user nova-compute[75006]: </disk>
Nov 27 03:26:39 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:39 user nova-compute[75006]: WARNING nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf for instance with vm_state building and task_state spawning.
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:39 user nova-compute[75006]: WARNING nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 for instance with vm_state building and task_state spawning.
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:39 user nova-compute[75006]: WARNING nova.compute.manager [req-d39a7d41-a850-4421-9d1d-032ddecba24f req-04fed6c7-eb22-427d-bfe6-315e078ae72b service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 for instance with vm_state building and task_state spawning.
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:39 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Took 0.56 seconds to deallocate network for instance.
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-80e17fcd-37cc-4a6f-98ad-c9d00e758add req-d8193a1a-0d48-4b6a-bfea-2c6fef132cda service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received event network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-80e17fcd-37cc-4a6f-98ad-c9d00e758add req-d8193a1a-0d48-4b6a-bfea-2c6fef132cda service nova] Acquiring lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-80e17fcd-37cc-4a6f-98ad-c9d00e758add req-d8193a1a-0d48-4b6a-bfea-2c6fef132cda service nova] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-80e17fcd-37cc-4a6f-98ad-c9d00e758add req-d8193a1a-0d48-4b6a-bfea-2c6fef132cda service nova] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-80e17fcd-37cc-4a6f-98ad-c9d00e758add req-d8193a1a-0d48-4b6a-bfea-2c6fef132cda service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] No waiting events found dispatching network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:40 user nova-compute[75006]: WARNING nova.compute.manager [req-80e17fcd-37cc-4a6f-98ad-c9d00e758add req-d8193a1a-0d48-4b6a-bfea-2c6fef132cda service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received unexpected event network-vif-plugged-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b for instance with vm_state deleted and task_state None.
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-80e17fcd-37cc-4a6f-98ad-c9d00e758add req-d8193a1a-0d48-4b6a-bfea-2c6fef132cda service nova] [instance: fd992ae2-0b97-47d2-9e03-f707af65f190] Received event network-vif-deleted-ac73c62b-63b9-4f60-ac24-5f3ff2d26a9b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:40 user nova-compute[75006]: WARNING nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a for instance with vm_state building and task_state spawning.
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:40 user nova-compute[75006]: WARNING nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 for instance with vm_state building and task_state spawning.
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:40 user nova-compute[75006]: WARNING nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 for instance with vm_state building and task_state spawning.
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:40 user nova-compute[75006]: WARNING nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 for instance with vm_state building and task_state spawning.
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:40 user nova-compute[75006]: WARNING nova.compute.manager [req-cc143fb5-e407-4d0b-b843-fb494287a51d req-7d7d08b2-29a0-40bc-a662-2c4838731674 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 for instance with vm_state building and task_state spawning.
Nov 27 03:26:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:40 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Deleted allocations for instance fd992ae2-0b97-47d2-9e03-f707af65f190
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-490054ae-9985-40a6-b466-15120ed48b2c tempest-ServersNegativeTestJSON-809508397 tempest-ServersNegativeTestJSON-809508397-project-member] Lock "fd992ae2-0b97-47d2-9e03-f707af65f190" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.082s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No VIF found with MAC fa:16:3e:4f:82:0a, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:26:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-16ef7201-0214-47be-9921-442da9da7ac3 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.361s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:41 user nova-compute[75006]: WARNING nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 for instance with vm_state building and task_state spawning.
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:41 user nova-compute[75006]: WARNING nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 for instance with vm_state building and task_state spawning.
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:41 user nova-compute[75006]: WARNING nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 for instance with vm_state building and task_state spawning.
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:41 user nova-compute[75006]: WARNING nova.compute.manager [req-14ea75cf-39a9-4344-9ae9-33d00310550f req-463dc489-445f-40ad-9c6e-f813bcd849e0 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 for instance with vm_state building and task_state spawning.
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:41 user nova-compute[75006]: INFO nova.compute.manager [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Detaching volume 6b2699ff-bb36-497a-bc1c-835c889dc691
Nov 27 03:26:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:41 user nova-compute[75006]: INFO nova.virt.block_device [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Attempting to driver detach volume 6b2699ff-bb36-497a-bc1c-835c889dc691 from mountpoint /dev/vdb
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Attempting to detach device vdb from instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:26:41 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:41 user nova-compute[75006]:   <source dev="/dev/sdh"/>
Nov 27 03:26:41 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:41 user nova-compute[75006]:   <serial>6b2699ff-bb36-497a-bc1c-835c889dc691</serial>
Nov 27 03:26:41 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:26:41 user nova-compute[75006]: </disk>
Nov 27 03:26:41 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:26:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully detached device vdb from instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 from the persistent domain config.
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:26:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:26:41 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:41 user nova-compute[75006]:   <source dev="/dev/sdh"/>
Nov 27 03:26:41 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:41 user nova-compute[75006]:   <serial>6b2699ff-bb36-497a-bc1c-835c889dc691</serial>
Nov 27 03:26:41 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:26:41 user nova-compute[75006]: </disk>
Nov 27 03:26:41 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:26:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:26:43 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance spawned successfully.
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:26:43 user nova-compute[75006]: INFO nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Took 12.52 seconds to spawn the instance on the hypervisor.
Nov 27 03:26:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:26:43 user nova-compute[75006]: INFO nova.compute.manager [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Took 36.60 seconds to build instance.
Nov 27 03:26:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-78f2274a-8ec8-46a6-aeb3-bdebf12d3340 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.725s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-53370f1a-8d3e-4840-86c6-f88d5b0634e5 req-66bfb3c7-c06f-41a7-984c-51c2a832b90d service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received event network-changed-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-53370f1a-8d3e-4840-86c6-f88d5b0634e5 req-66bfb3c7-c06f-41a7-984c-51c2a832b90d service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Refreshing instance network info cache due to event network-changed-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-53370f1a-8d3e-4840-86c6-f88d5b0634e5 req-66bfb3c7-c06f-41a7-984c-51c2a832b90d service nova] Acquiring lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-53370f1a-8d3e-4840-86c6-f88d5b0634e5 req-66bfb3c7-c06f-41a7-984c-51c2a832b90d service nova] Acquired lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-53370f1a-8d3e-4840-86c6-f88d5b0634e5 req-66bfb3c7-c06f-41a7-984c-51c2a832b90d service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Refreshing network info cache for port 63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-53370f1a-8d3e-4840-86c6-f88d5b0634e5 req-66bfb3c7-c06f-41a7-984c-51c2a832b90d service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Updated VIF entry in instance network info cache for port 63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-53370f1a-8d3e-4840-86c6-f88d5b0634e5 req-66bfb3c7-c06f-41a7-984c-51c2a832b90d service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Updating instance_info_cache with network_info: [{"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-53370f1a-8d3e-4840-86c6-f88d5b0634e5 req-66bfb3c7-c06f-41a7-984c-51c2a832b90d service nova] Releasing lock "refresh_cache-32bf5b72-4409-4608-b933-8aa4b99e95ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG nova.objects.instance [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lazy-loading 'flavor' on Instance uuid 32bf5b72-4409-4608-b933-8aa4b99e95ab {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:47 user nova-compute[75006]: INFO nova.compute.manager [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Attaching volume 4731403d-511f-4b56-94ae-2ea356eb27d5 to /dev/vdb
Nov 27 03:26:47 user nova-compute[75006]: DEBUG os_brick.utils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed77c33-4d99-4f38-863c-65b4442cd58b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45059b3-0d2b-4bdd-aa9a-e7a5c7baa91c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c262fc58-6121-47d8-9e9c-45564f16f9d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38f1550-669a-4c5b-b3d8-93c327580ae8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:26:47 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:26:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7875fecc-fc43-4b18-973d-1d7d62e9f08a]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG os_brick.utils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:47 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Updating existing volume attachment record: 44854111-b216-41a3-ac7e-a25e8ac74dab {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:26:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:26:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:52 user nova-compute[75006]: INFO nova.compute.manager [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Rescuing
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquired lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:52 user nova-compute[75006]: DEBUG nova.network.neutron [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updating instance_info_cache with network_info: [{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Releasing lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c3c59b3-0824-4e27-bf42-91355c13dce8 req-42a3d304-9327-4d49-b9e1-5257c603e3c0 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c3c59b3-0824-4e27-bf42-91355c13dce8 req-42a3d304-9327-4d49-b9e1-5257c603e3c0 service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c3c59b3-0824-4e27-bf42-91355c13dce8 req-42a3d304-9327-4d49-b9e1-5257c603e3c0 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0c3c59b3-0824-4e27-bf42-91355c13dce8 req-42a3d304-9327-4d49-b9e1-5257c603e3c0 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c3c59b3-0824-4e27-bf42-91355c13dce8 req-42a3d304-9327-4d49-b9e1-5257c603e3c0 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:53 user nova-compute[75006]: WARNING nova.compute.manager [req-0c3c59b3-0824-4e27-bf42-91355c13dce8 req-42a3d304-9327-4d49-b9e1-5257c603e3c0 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state active and task_state rescuing.
Nov 27 03:26:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance destroyed successfully.
Nov 27 03:26:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Attempting rescue
Nov 27 03:26:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75006) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance directory exists: not creating {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 03:26:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Creating image(s)
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG nova.objects.instance [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'trusted_certs' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.560s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.rescue {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:26:55 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7397MB free_disk=25.405136108398438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.rescue" returned: 0 in 0.062s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.627s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'migration_context' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.base [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<831e3e26-daed-4b73-9470-0383e2cf6e0f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Start _get_guest_xml network_info=[{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:09:88:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'resources' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.base [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<831e3e26-daed-4b73-9470-0383e2cf6e0f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'numa_topology' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.base [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<831e3e26-daed-4b73-9470-0383e2cf6e0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:26:55 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:26:55 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'vcpu_model' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.base [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<831e3e26-daed-4b73-9470-0383e2cf6e0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1753296171',display_name='tempest-ServerRescueNegativeTestJSON-server-1753296171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1753296171',id=18,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-05m618k5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:22:18Z,user_data=None,user_id='797a8975406044ddabaad6e23950a71b',uuid=831e3e26-daed-4b73-9470-0383e2cf6e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:09:88:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:09:88:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:88:83,bridge_name='br-int',has_traffic_filtering=True,id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ff1b53-23') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'pci_devices' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Applying migration context for instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 as it has an incoming, in-progress migration b695dec7-47e0-43c3-baf4-14dd85effaf2. Migration status is finished {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 03:26:55 user nova-compute[75006]: INFO nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating resource usage from migration b695dec7-47e0-43c3-baf4-14dd85effaf2
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.objects.base [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<831e3e26-daed-4b73-9470-0383e2cf6e0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:26:55 user nova-compute[75006]:   <uuid>831e3e26-daed-4b73-9470-0383e2cf6e0f</uuid>
Nov 27 03:26:55 user nova-compute[75006]:   <name>instance-00000012</name>
Nov 27 03:26:55 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:26:55 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:26:55 user nova-compute[75006]:   <metadata>
Nov 27 03:26:55 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:26:55 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:26:55 user nova-compute[75006]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1753296171</nova:name>
Nov 27 03:26:55 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:26:55</nova:creationTime>
Nov 27 03:26:55 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:26:55 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:26:55 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:26:55 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:26:55 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:26:55 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:26:55 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:26:55 user nova-compute[75006]:       <nova:owner>
Nov 27 03:26:55 user nova-compute[75006]:         <nova:user uuid="797a8975406044ddabaad6e23950a71b">tempest-ServerRescueNegativeTestJSON-599355303-project-member</nova:user>
Nov 27 03:26:55 user nova-compute[75006]:         <nova:project uuid="7b2d179ed36d41038da75b63b1bde170">tempest-ServerRescueNegativeTestJSON-599355303</nova:project>
Nov 27 03:26:55 user nova-compute[75006]:       </nova:owner>
Nov 27 03:26:55 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:26:55 user nova-compute[75006]:       <nova:ports>
Nov 27 03:26:55 user nova-compute[75006]:         <nova:port uuid="12ff1b53-230e-4e26-87d3-d3e6820f3bfd">
Nov 27 03:26:55 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:26:55 user nova-compute[75006]:         </nova:port>
Nov 27 03:26:55 user nova-compute[75006]:       </nova:ports>
Nov 27 03:26:55 user nova-compute[75006]:     </nova:instance>
Nov 27 03:26:55 user nova-compute[75006]:   </metadata>
Nov 27 03:26:55 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:26:55 user nova-compute[75006]:     <system>
Nov 27 03:26:55 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:26:55 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:26:55 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:26:55 user nova-compute[75006]:       <entry name="serial">831e3e26-daed-4b73-9470-0383e2cf6e0f</entry>
Nov 27 03:26:55 user nova-compute[75006]:       <entry name="uuid">831e3e26-daed-4b73-9470-0383e2cf6e0f</entry>
Nov 27 03:26:55 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:26:55 user nova-compute[75006]:     </system>
Nov 27 03:26:55 user nova-compute[75006]:   </sysinfo>
Nov 27 03:26:55 user nova-compute[75006]:   <os>
Nov 27 03:26:55 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:26:55 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:26:55 user nova-compute[75006]:   </os>
Nov 27 03:26:55 user nova-compute[75006]:   <features>
Nov 27 03:26:55 user nova-compute[75006]:     <acpi/>
Nov 27 03:26:55 user nova-compute[75006]:     <apic/>
Nov 27 03:26:55 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:26:55 user nova-compute[75006]:   </features>
Nov 27 03:26:55 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:26:55 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:26:55 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:26:55 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:26:55 user nova-compute[75006]:   </clock>
Nov 27 03:26:55 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:26:55 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:26:55 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:26:55 user nova-compute[75006]:   </cpu>
Nov 27 03:26:55 user nova-compute[75006]:   <devices>
Nov 27 03:26:55 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:26:55 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:26:55 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.rescue"/>
Nov 27 03:26:55 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:26:55 user nova-compute[75006]:     </disk>
Nov 27 03:26:55 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:26:55 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:26:55 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk"/>
Nov 27 03:26:55 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:26:55 user nova-compute[75006]:     </disk>
Nov 27 03:26:55 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:26:55 user nova-compute[75006]:       <mac address="fa:16:3e:09:88:83"/>
Nov 27 03:26:55 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:55 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:26:55 user nova-compute[75006]:       <target dev="tap12ff1b53-23"/>
Nov 27 03:26:55 user nova-compute[75006]:     </interface>
Nov 27 03:26:55 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:26:55 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/console.log" append="off"/>
Nov 27 03:26:55 user nova-compute[75006]:     </serial>
Nov 27 03:26:55 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:26:55 user nova-compute[75006]:     <video>
Nov 27 03:26:55 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:26:55 user nova-compute[75006]:     </video>
Nov 27 03:26:55 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:26:55 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:26:55 user nova-compute[75006]:     </rng>
Nov 27 03:26:55 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:26:55 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:26:55 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:26:55 user nova-compute[75006]:     </memballoon>
Nov 27 03:26:55 user nova-compute[75006]:   </devices>
Nov 27 03:26:55 user nova-compute[75006]: </domain>
Nov 27 03:26:55 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:26:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance destroyed successfully.
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 4921430a-67cc-418f-932f-c7249c8d2b31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 32bf5b72-4409-4608-b933-8aa4b99e95ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Migration b695dec7-47e0-43c3-baf4-14dd85effaf2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 90630ecf-9ed5-47cc-b7b9-b313ed57e46f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No VIF found with MAC fa:16:3e:09:88:83, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjmYQUns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:26:55 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:55 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:26:55 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99311be-5155-4875-867a-078456a30f32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:26:55 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b58006-0871-4f41-980e-bc09ff40f27f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5] added
Nov 27 03:26:55 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d561a70-0ccb-475d-a635-9939307042ce]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec0c0e-1150-4829-a1f3-c0f6cc683102]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjmYQUns {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wjmYQUns" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[28097fea-f41e-4d9d-84ba-e8ab3100f81f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wjmYQUns'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d043ba-b69e-4980-9281-eab3863eae6d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d26e256-9391-478d-9c71-67f166fb6d0f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[92559508-c7d8-46c7-9b51-91f1794e69d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5, portal: 172.16.0.220,3260]
Nov 27 03:26:55 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5, portal: 172.16.0.220,3260] successful.
Nov 27 03:26:55 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2c0c85-dd6e-4048-b7a3-e15c42efa7be]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c35d5-9857-4148-8a3d-e5f889247ede]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:26:55 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] HCTL ('40', '-', '-', 0) found on session 29 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.035s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbed295-d9d1-4b23-bb2c-5d309bffcc9c]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Searching for a device in session 29 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjmYQUns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a08ef35-8436-4fef-8fbe-e65203a47a1c req-9302c15a-d8c4-4715-9a4e-f34977f716b5 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a08ef35-8436-4fef-8fbe-e65203a47a1c req-9302c15a-d8c4-4715-9a4e-f34977f716b5 service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a08ef35-8436-4fef-8fbe-e65203a47a1c req-9302c15a-d8c4-4715-9a4e-f34977f716b5 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a08ef35-8436-4fef-8fbe-e65203a47a1c req-9302c15a-d8c4-4715-9a4e-f34977f716b5 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a08ef35-8436-4fef-8fbe-e65203a47a1c req-9302c15a-d8c4-4715-9a4e-f34977f716b5 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:55 user nova-compute[75006]: WARNING nova.compute.manager [req-6a08ef35-8436-4fef-8fbe-e65203a47a1c req-9302c15a-d8c4-4715-9a4e-f34977f716b5 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state active and task_state rescuing.
Nov 27 03:26:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23966363836346536', 'path': '/dev/sdi'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966363836346536', 'path': '/dev/sdi'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG nova.objects.instance [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lazy-loading 'flavor' on Instance uuid 32bf5b72-4409-4608-b933-8aa4b99e95ab {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:26:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:26:56 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:56 user nova-compute[75006]:   <source dev="/dev/sdi"/>
Nov 27 03:26:56 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:56 user nova-compute[75006]:   <serial>4731403d-511f-4b56-94ae-2ea356eb27d5</serial>
Nov 27 03:26:56 user nova-compute[75006]: </disk>
Nov 27 03:26:56 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [{"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-70a4bf10-12f0-4b99-baa2-53be7becbb21" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] No VIF found with MAC fa:16:3e:8e:26:5b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:26:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-405ca771-1535-486b-9df6-6fd5e9b68bb0 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.137s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:58 user nova-compute[75006]: WARNING nova.compute.manager [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state active and task_state rescuing.
Nov 27 03:26:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:26:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:26:58 user nova-compute[75006]: WARNING nova.compute.manager [req-3aad47c6-10e1-4d68-adb4-ed39b9a8367c req-335eec13-75d9-42f9-9336-35d98aad2bbd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state active and task_state rescuing.
Nov 27 03:26:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:26:58 user nova-compute[75006]: INFO nova.compute.manager [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] instance snapshotting
Nov 27 03:26:58 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Beginning live snapshot process
Nov 27 03:26:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json -f qcow2 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:59 user nova-compute[75006]: INFO nova.compute.manager [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Detaching volume d5aa874e-47a6-41ad-9514-fa5c287f8845
Nov 27 03:26:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json -f qcow2" returned: 0 in 0.248s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json -f qcow2 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:59 user nova-compute[75006]: INFO nova.virt.block_device [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Attempting to driver detach volume d5aa874e-47a6-41ad-9514-fa5c287f8845 from mountpoint /dev/vdb
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Attempting to detach device vdb from instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:26:59 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:59 user nova-compute[75006]:   <source dev="/dev/sdg"/>
Nov 27 03:26:59 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:59 user nova-compute[75006]:   <serial>d5aa874e-47a6-41ad-9514-fa5c287f8845</serial>
Nov 27 03:26:59 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:26:59 user nova-compute[75006]: </disk>
Nov 27 03:26:59 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:26:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Successfully detached device vdb from instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 from the persistent domain config.
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:26:59 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:59 user nova-compute[75006]:   <source dev="/dev/sdg"/>
Nov 27 03:26:59 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:59 user nova-compute[75006]:   <serial>d5aa874e-47a6-41ad-9514-fa5c287f8845</serial>
Nov 27 03:26:59 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:26:59 user nova-compute[75006]: </disk>
Nov 27 03:26:59 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json -f qcow2" returned: 0 in 0.272s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.compute.manager [None req-45e1087d-d45b-4e1d-948f-03d715141c56 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2gak2oud/cff7b3ce71cf4cf5a9f4a28e0967f096.delta 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:26:59 user nova-compute[75006]: INFO nova.compute.manager [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Detaching volume 4731403d-511f-4b56-94ae-2ea356eb27d5
Nov 27 03:26:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2gak2oud/cff7b3ce71cf4cf5a9f4a28e0967f096.delta 1073741824" returned: 0 in 0.063s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:26:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 03:26:59 user nova-compute[75006]: INFO nova.virt.block_device [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Attempting to driver detach volume 4731403d-511f-4b56-94ae-2ea356eb27d5 from mountpoint /dev/vdb
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Attempting to detach device vdb from instance 32bf5b72-4409-4608-b933-8aa4b99e95ab from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:26:59 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:59 user nova-compute[75006]:   <source dev="/dev/sdi"/>
Nov 27 03:26:59 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:59 user nova-compute[75006]:   <serial>4731403d-511f-4b56-94ae-2ea356eb27d5</serial>
Nov 27 03:26:59 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:26:59 user nova-compute[75006]: </disk>
Nov 27 03:26:59 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:26:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Successfully detached device vdb from instance 32bf5b72-4409-4608-b933-8aa4b99e95ab from the persistent domain config.
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 32bf5b72-4409-4608-b933-8aa4b99e95ab from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:26:59 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:26:59 user nova-compute[75006]:   <source dev="/dev/sdi"/>
Nov 27 03:26:59 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:26:59 user nova-compute[75006]:   <serial>4731403d-511f-4b56-94ae-2ea356eb27d5</serial>
Nov 27 03:26:59 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:26:59 user nova-compute[75006]: </disk>
Nov 27 03:26:59 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:26:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:27:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4921430a-67cc-418f-932f-c7249c8d2b31 is timed out.
Nov 27 03:27:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Successfully detached device vdb from instance 4921430a-67cc-418f-932f-c7249c8d2b31 from the live domain config.
Nov 27 03:27:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfUsWoRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:00 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae94af6-616f-4b04-893a-306a346ec90c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:27:00 user nova-compute[75006]: No targets found.
Nov 27 03:27:00 user nova-compute[75006]: iSNS:
Nov 27 03:27:00 user nova-compute[75006]: No targets found.
Nov 27 03:27:00 user nova-compute[75006]: STATIC:
Nov 27 03:27:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431
Nov 27 03:27:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842
Nov 27 03:27:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691
Nov 27 03:27:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5
Nov 27 03:27:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:27:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:27:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845
Nov 27 03:27:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6
Nov 27 03:27:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:00 user nova-compute[75006]: FIRMWARE:
Nov 27 03:27:00 user nova-compute[75006]: No targets found.
Nov 27 03:27:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:27:00 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:27:00 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c5e15e-cd51-4ac1-9cc9-78c23254930d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e644354f-3a55-48fc-802a-d483afbc8c9a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:27:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4244db490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e7ac6a-eed5-444c-b0d9-d391f93a2e0e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a1fdb-0b55-4f0e-83e6-823375139188]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b79fc7-b7d2-48ef-a4d7-d0c34ef3e3ee]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.082s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb985255-2a43-4254-a00f-3f5ae18ff961]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c5d956-fd8f-4ab1-afc7-fe91dfaaff09]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd66726d-21da-4428-8085-b449b3f9abab]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842, portal: 172.16.0.220,3260]
Nov 27 03:27:00 user nova-compute[75006]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842, portal: 172.16.0.220,3260] successful.
Nov 27 03:27:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc2f8e73-674d-4ca3-a1a2-125d3948c842 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5652d492-26ac-4db4-84db-77debcabe70b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] <== disconnect_volume: return (407ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:27:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 32bf5b72-4409-4608-b933-8aa4b99e95ab {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:27:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] COPY block job progress, current cursor: 6553600 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:27:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] COPY block job progress, current cursor: 21168128 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:27:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lazy-loading 'flavor' on Instance uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-41581cf8-f6a0-45a7-a157-cd802a64b0c1 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.697s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:27:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 03:27:02 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2gak2oud/cff7b3ce71cf4cf5a9f4a28e0967f096.delta /opt/stack/data/nova/instances/snapshots/tmp2gak2oud/cff7b3ce71cf4cf5a9f4a28e0967f096 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 is timed out.
Nov 27 03:27:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully detached device vdb from instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3 from the live domain config.
Nov 27 03:27:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WliGzhoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:02 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.086s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa8ca13-ff31-4573-893b-240fbd5dd195]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:27:02 user nova-compute[75006]: No targets found.
Nov 27 03:27:02 user nova-compute[75006]: iSNS:
Nov 27 03:27:02 user nova-compute[75006]: No targets found.
Nov 27 03:27:02 user nova-compute[75006]: STATIC:
Nov 27 03:27:02 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431
Nov 27 03:27:02 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:02 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:02 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691
Nov 27 03:27:02 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:02 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:02 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5
Nov 27 03:27:02 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:02 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:02 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:27:02 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:02 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:02 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:27:02 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:02 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:02 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845
Nov 27 03:27:02 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:02 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:02 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6
Nov 27 03:27:02 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:02 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:02 user nova-compute[75006]: FIRMWARE:
Nov 27 03:27:02 user nova-compute[75006]: No targets found.
Nov 27 03:27:02 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:27:02 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:27:02 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d88cc6-9a69-416d-bdf6-ab6d98ef0302]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4c14f1-bff9-4246-861f-b2d3c11a75ea]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:27:02 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd424588f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691'): ({'sdh'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Removing single pathed devices sdh {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[54575056-f59d-4135-89de-b2cb9e680e14]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.037s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd4c039-c6cd-4b33-b5a2-4ecf97223d45]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flushing IO for device /dev/sdh {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6de1b0-6793-4bf6-b2a9-227bb95daf26]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.062s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc3a1b3-472d-4306-a4be-79dbaea00306]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] SCSI volumes sdh have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2gak2oud/cff7b3ce71cf4cf5a9f4a28e0967f096.delta /opt/stack/data/nova/instances/snapshots/tmp2gak2oud/cff7b3ce71cf4cf5a9f4a28e0967f096" returned: 0 in 0.476s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Snapshot extracted, beginning image upload
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23202a7-9de2-48fe-aec5-4a55a378a82d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd57fe5-11f2-4cb6-bbe3-d5e982410a12]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691, portal: 172.16.0.220,3260]
Nov 27 03:27:02 user nova-compute[75006]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691, portal: 172.16.0.220,3260] successful.
Nov 27 03:27:02 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b2699ff-bb36-497a-bc1c-835c889dc691 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de11d0-13a4-467f-acdd-6d1fddd41cf2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.545s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== disconnect_volume: return (547ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:27:03 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid b90e98c7-3949-4b69-80c7-2a5b85bc88a3 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6ebce727-348f-4504-8eb9-221bde476250 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.064s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Snapshot image upload complete
Nov 27 03:27:05 user nova-compute[75006]: INFO nova.compute.manager [None req-0f40eaa4-65c1-4450-bf7f-8aa1fbcd3d24 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Took 6.81 seconds to snapshot the instance on the hypervisor.
Nov 27 03:27:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:19 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 is timed out.
Nov 27 03:27:19 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Successfully detached device vdb from instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 from the live domain config.
Nov 27 03:27:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WraAoJxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:19 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[09244f9f-ca8d-4bc8-98dd-74a1a8269ce2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:27:19 user nova-compute[75006]: No targets found.
Nov 27 03:27:19 user nova-compute[75006]: iSNS:
Nov 27 03:27:19 user nova-compute[75006]: No targets found.
Nov 27 03:27:19 user nova-compute[75006]: STATIC:
Nov 27 03:27:19 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431
Nov 27 03:27:19 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:19 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:19 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5
Nov 27 03:27:19 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:19 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:19 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:27:19 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:19 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:19 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:27:19 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:19 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:19 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845
Nov 27 03:27:19 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:19 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:19 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6
Nov 27 03:27:19 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:19 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:19 user nova-compute[75006]: FIRMWARE:
Nov 27 03:27:19 user nova-compute[75006]: No targets found.
Nov 27 03:27:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:27:19 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:27:19 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df69ee7-3e99-4da7-b632-fde28691eb7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c8fe03-73a6-4f23-bd0d-0d2b0a32a2f8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:27:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd444055cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845'): ({'sdg'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Removing single pathed devices sdg {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c31271-acaa-427d-9c1c-fe8f7d35dd56]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0424d055-62b5-4e65-a269-7f2a120f34ef]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Flushing IO for device /dev/sdg {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502ddfc-d2a4-4518-85e8-bc963dd182e8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b22088-bcf5-4365-b381-ecaa5fe38d80]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] SCSI volumes sdg have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a98602-f317-445f-9f5e-a2c237a5bd9e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebde9650-0cd7-4015-be8d-fc1e6c9a61f6]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845, portal: 172.16.0.220,3260]
Nov 27 03:27:20 user nova-compute[75006]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845, portal: 172.16.0.220,3260] successful.
Nov 27 03:27:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36669b1-bdf5-4ca0-82de-0eeae42a1d8b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] <== disconnect_volume: return (350ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:27:20 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 32bf5b72-4409-4608-b933-8aa4b99e95ab is timed out.
Nov 27 03:27:20 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Successfully detached device vdb from instance 32bf5b72-4409-4608-b933-8aa4b99e95ab from the live domain config.
Nov 27 03:27:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wjmYQUns', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:20 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4639c1-cad2-4748-9442-2bb6a86b4010]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:27:20 user nova-compute[75006]: No targets found.
Nov 27 03:27:20 user nova-compute[75006]: iSNS:
Nov 27 03:27:20 user nova-compute[75006]: No targets found.
Nov 27 03:27:20 user nova-compute[75006]: STATIC:
Nov 27 03:27:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431
Nov 27 03:27:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5
Nov 27 03:27:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:27:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:27:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:20 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6
Nov 27 03:27:20 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:20 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:20 user nova-compute[75006]: FIRMWARE:
Nov 27 03:27:20 user nova-compute[75006]: No targets found.
Nov 27 03:27:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:27:20 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:27:20 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9604ce31-68c7-4090-9340-c4cd6ad19973]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229a7a7-5636-4747-b676-ee37672f2325]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:20 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:20 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:20 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:20 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:27:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:20 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:20 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:20 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:20 user nova-compute[75006]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 (non-flash)
Nov 27 03:27:20 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5'): ({'sdi'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Removing single pathed devices sdi {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:27:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.objects.instance [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'flavor' on Instance uuid b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e800cbb8-c673-440a-99f8-4760aae92935]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8316f3f1-b5f7-4775-8415-0ac20b387681]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Flushing IO for device /dev/sdi {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ab3834-fdc5-4518-9ead-d0093832e087]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a0c0ef34-1826-4aaf-bdc8-992827301c25 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.985s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.756s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:21 user nova-compute[75006]: INFO nova.compute.manager [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Terminating instance
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b78c2c-8a53-457d-8629-56705592a939]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] SCSI volumes sdi have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc02fab-43e6-4c3f-8477-1867572ef2ff]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.141s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7c67c7-82e7-47c7-8d0a-f4a530aefcae]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5, portal: 172.16.0.220,3260]
Nov 27 03:27:21 user nova-compute[75006]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5, portal: 172.16.0.220,3260] successful.
Nov 27 03:27:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4731403d-511f-4b56-94ae-2ea356eb27d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd111aac-2405-48c1-95ac-e662eb7d3405]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] <== disconnect_volume: return (459ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-a1062d10-607b-4e56-97fd-523b4bbfc8a1 req-66e336b1-2304-4a63-bab3-64e8e23ceaa5 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received event network-vif-unplugged-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a1062d10-607b-4e56-97fd-523b4bbfc8a1 req-66e336b1-2304-4a63-bab3-64e8e23ceaa5 service nova] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a1062d10-607b-4e56-97fd-523b4bbfc8a1 req-66e336b1-2304-4a63-bab3-64e8e23ceaa5 service nova] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a1062d10-607b-4e56-97fd-523b4bbfc8a1 req-66e336b1-2304-4a63-bab3-64e8e23ceaa5 service nova] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-a1062d10-607b-4e56-97fd-523b4bbfc8a1 req-66e336b1-2304-4a63-bab3-64e8e23ceaa5 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] No waiting events found dispatching network-vif-unplugged-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-a1062d10-607b-4e56-97fd-523b4bbfc8a1 req-66e336b1-2304-4a63-bab3-64e8e23ceaa5 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received event network-vif-unplugged-211dc942-48f1-40b2-8deb-99e87eaee687 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Instance destroyed successfully.
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.objects.instance [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'resources' on Instance uuid b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1940306102',display_name='tempest-VolumesSnapshotTestJSON-instance-1940306102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1940306102',id=21,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh2Fl7phxPL1LZUqmTP4aNcFaAtpJtTb4OWEfMk0oQ+mjVDoQX2n/8TtK7wY0ZSBn0cnFoTzaTQjmms93tS8atT50FlZdTGIvd/W3BYXCZcz9GdroRoFKCscxIaKN7DOg==',key_name='tempest-keypair-1522167447',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:24:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ada4ca9c11a4996ad5f00f6beac2398',ramdisk_id='',reservation_id='r-m4306fz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-59016333',owner_user_name='tempest-VolumesSnapshotTestJSON-59016333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b50c3d4e86ae40fbb9f38f2a88066a03',uuid=b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converting VIF {"id": "211dc942-48f1-40b2-8deb-99e87eaee687", "address": "fa:16:3e:3b:fd:19", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap211dc942-48", "ovs_interfaceid": "211dc942-48f1-40b2-8deb-99e87eaee687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=211dc942-48f1-40b2-8deb-99e87eaee687,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211dc942-48') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_vif [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=211dc942-48f1-40b2-8deb-99e87eaee687,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211dc942-48') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap211dc942-48, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=424b7322-45d8-4fc1-b44d-86703c026b00) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:21 user nova-compute[75006]: INFO os_vif [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:fd:19,bridge_name='br-int',has_traffic_filtering=True,id=211dc942-48f1-40b2-8deb-99e87eaee687,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap211dc942-48')
Nov 27 03:27:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WraAoJxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:21 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dd5ad4-1d5a-469f-ae82-009e12783d94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:27:21 user nova-compute[75006]: No targets found.
Nov 27 03:27:21 user nova-compute[75006]: iSNS:
Nov 27 03:27:21 user nova-compute[75006]: No targets found.
Nov 27 03:27:21 user nova-compute[75006]: STATIC:
Nov 27 03:27:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431
Nov 27 03:27:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:27:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:27:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6
Nov 27 03:27:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:21 user nova-compute[75006]: FIRMWARE:
Nov 27 03:27:21 user nova-compute[75006]: No targets found.
Nov 27 03:27:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:27:21 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:27:21 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5aa874e-47a6-41ad-9514-fa5c287f8845', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[74887fb9-d670-4506-acf9-4070dad3ed82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aff6f0b-d7e1-4cf2-a47d-9e5138dde8ac]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:22 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:22 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:22 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:22 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:22 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:22 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4007296c0>, {}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Disconnecting from: [] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] <== disconnect_volume: return (82ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:27:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Deleting instance files /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663_del
Nov 27 03:27:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Deletion of /opt/stack/data/nova/instances/b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663_del complete
Nov 27 03:27:22 user nova-compute[75006]: INFO nova.compute.manager [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 27 03:27:22 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG nova.objects.instance [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lazy-loading 'flavor' on Instance uuid 32bf5b72-4409-4608-b933-8aa4b99e95ab {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf4ebef-a102-40e4-b029-d6d9272aa4ce tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.520s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:23 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:23 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Took 1.02 seconds to deallocate network for instance.
Nov 27 03:27:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-594be439-9534-4fd4-b245-a2f4e5d35c1a req-96341279-88f3-4076-b05f-4ce4daccfa93 service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received event network-vif-deleted-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:23 user nova-compute[75006]: WARNING nova.volume.cinder [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Attachment e1748e4f-ad0c-46d1-b148-537688f3c59f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e1748e4f-ad0c-46d1-b148-537688f3c59f. (HTTP 404) (Request-ID: req-24f2f65e-214d-464d-a5d2-4474236461ca)
Nov 27 03:27:23 user nova-compute[75006]: INFO nova.compute.manager [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Took 0.06 seconds to detach 1 volumes for instance.
Nov 27 03:27:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-f93d773e-0dab-4065-810a-f4cc54f0a784 req-63c748ca-7ff9-4476-b174-8f8ba6d66c8e service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received event network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f93d773e-0dab-4065-810a-f4cc54f0a784 req-63c748ca-7ff9-4476-b174-8f8ba6d66c8e service nova] Acquiring lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f93d773e-0dab-4065-810a-f4cc54f0a784 req-63c748ca-7ff9-4476-b174-8f8ba6d66c8e service nova] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f93d773e-0dab-4065-810a-f4cc54f0a784 req-63c748ca-7ff9-4476-b174-8f8ba6d66c8e service nova] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-f93d773e-0dab-4065-810a-f4cc54f0a784 req-63c748ca-7ff9-4476-b174-8f8ba6d66c8e service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] No waiting events found dispatching network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:23 user nova-compute[75006]: WARNING nova.compute.manager [req-f93d773e-0dab-4065-810a-f4cc54f0a784 req-63c748ca-7ff9-4476-b174-8f8ba6d66c8e service nova] [instance: b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663] Received unexpected event network-vif-plugged-211dc942-48f1-40b2-8deb-99e87eaee687 for instance with vm_state deleted and task_state None.
Nov 27 03:27:23 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:24 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.775s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:24 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Deleted allocations for instance b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663
Nov 27 03:27:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f814fb87-ab2b-4c9b-9ec9-40e307669408 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "b0883a5f-6bb0-4cf7-bc68-fa8ff2bef663" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.147s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:29 user nova-compute[75006]: INFO nova.compute.manager [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Terminating instance
Nov 27 03:27:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Instance destroyed successfully.
Nov 27 03:27:30 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lazy-loading 'resources' on Instance uuid 4921430a-67cc-418f-932f-c7249c8d2b31 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:23:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1802484279',display_name='tempest-TestServerVolumeAttachmentScenario-server-1802484279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1802484279',id=20,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAymbzw2TbqeQ1Si9sioS0k6okcAOTMn/mIzUtRzfrZfva86zYB1vtG0StrsoXkyokIUBRtZed9vOzDzZpOM4W91Uv1TzwTAmGY7Z65X2Au7XAZ2aYlwWDJ/dXB/c6Dww==',key_name='tempest-keypair-326478977',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ecd6ee9712450f9baaecf096a510ad',ramdisk_id='',reservation_id='r-7n9w6ag8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2131034638',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2131034638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b516ef03ccc4fd1be4195d9b4cd35b1',uuid=4921430a-67cc-418f-932f-c7249c8d2b31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Converting VIF {"id": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "address": "fa:16:3e:f3:a9:82", "network": {"id": "d060a651-af88-4342-a1cd-c59ebeda4c14", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2108598726-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ecd6ee9712450f9baaecf096a510ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a39f5fd-b5", "ovs_interfaceid": "1a39f5fd-b558-47c4-bda3-3248d68aa175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a9:82,bridge_name='br-int',has_traffic_filtering=True,id=1a39f5fd-b558-47c4-bda3-3248d68aa175,network=Network(d060a651-af88-4342-a1cd-c59ebeda4c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a39f5fd-b5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG os_vif [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a9:82,bridge_name='br-int',has_traffic_filtering=True,id=1a39f5fd-b558-47c4-bda3-3248d68aa175,network=Network(d060a651-af88-4342-a1cd-c59ebeda4c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a39f5fd-b5') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a39f5fd-b5, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=caea1c8e-67ce-4217-a33d-8090617c98e6) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:30 user nova-compute[75006]: INFO os_vif [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:a9:82,bridge_name='br-int',has_traffic_filtering=True,id=1a39f5fd-b558-47c4-bda3-3248d68aa175,network=Network(d060a651-af88-4342-a1cd-c59ebeda4c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a39f5fd-b5')
Nov 27 03:27:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Deleting instance files /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31_del
Nov 27 03:27:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Deletion of /opt/stack/data/nova/instances/4921430a-67cc-418f-932f-c7249c8d2b31_del complete
Nov 27 03:27:30 user nova-compute[75006]: INFO nova.compute.manager [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 27 03:27:30 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:27:30 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:27:31 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:31 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Took 0.63 seconds to deallocate network for instance.
Nov 27 03:27:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-e0756e19-d335-4795-8212-7734796d5144 req-c7581272-a6c5-4ec4-9acf-54a589252ec2 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Received event network-vif-deleted-1a39f5fd-b558-47c4-bda3-3248d68aa175 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:31 user nova-compute[75006]: INFO nova.compute.manager [req-e0756e19-d335-4795-8212-7734796d5144 req-c7581272-a6c5-4ec4-9acf-54a589252ec2 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Neutron deleted interface 1a39f5fd-b558-47c4-bda3-3248d68aa175; detaching it from the instance and deleting it from the info cache
Nov 27 03:27:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-e0756e19-d335-4795-8212-7734796d5144 req-c7581272-a6c5-4ec4-9acf-54a589252ec2 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-e0756e19-d335-4795-8212-7734796d5144 req-c7581272-a6c5-4ec4-9acf-54a589252ec2 service nova] [instance: 4921430a-67cc-418f-932f-c7249c8d2b31] Detach interface failed, port_id=1a39f5fd-b558-47c4-bda3-3248d68aa175, reason: Instance 4921430a-67cc-418f-932f-c7249c8d2b31 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:27:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:31 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:31 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Deleted allocations for instance 4921430a-67cc-418f-932f-c7249c8d2b31
Nov 27 03:27:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8b26f520-41aa-4f7e-a957-6490b000b9f5 tempest-TestServerVolumeAttachmentScenario-2131034638 tempest-TestServerVolumeAttachmentScenario-2131034638-project-member] Lock "4921430a-67cc-418f-932f-c7249c8d2b31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.029s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:32 user nova-compute[75006]: INFO nova.compute.manager [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Terminating instance
Nov 27 03:27:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:32 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Instance destroyed successfully.
Nov 27 03:27:32 user nova-compute[75006]: DEBUG nova.objects.instance [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'resources' on Instance uuid b90e98c7-3949-4b69-80c7-2a5b85bc88a3 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-428956732',display_name='tempest-AttachVolumeNegativeTest-server-428956732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-428956732',id=22,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxInvwi2ZIWx5YeU+NVkLy9NftFN6c/+WzWH5G82JbMkyuqM5WXSicOvUHSnqm9jLPi8C2edPV14/ZxqqUQu+mNIhovKcanFpzdYsDqVaR1fsJI7iP8gbhmNAXTT6ansQ==',key_name='tempest-keypair-1602117111',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:24:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-zdvh5yoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:24:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=b90e98c7-3949-4b69-80c7-2a5b85bc88a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "address": "fa:16:3e:4f:82:0a", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa662b2-e1", "ovs_interfaceid": "aaa662b2-e109-4a0a-9d8d-2d6e2734dfec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:82:0a,bridge_name='br-int',has_traffic_filtering=True,id=aaa662b2-e109-4a0a-9d8d-2d6e2734dfec,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa662b2-e1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG os_vif [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:82:0a,bridge_name='br-int',has_traffic_filtering=True,id=aaa662b2-e109-4a0a-9d8d-2d6e2734dfec,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa662b2-e1') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaa662b2-e1, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54d42a53-ec68-40cd-b9b3-e4a270587002) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:33 user nova-compute[75006]: INFO os_vif [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:82:0a,bridge_name='br-int',has_traffic_filtering=True,id=aaa662b2-e109-4a0a-9d8d-2d6e2734dfec,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa662b2-e1')
Nov 27 03:27:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Deleting instance files /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3_del
Nov 27 03:27:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Deletion of /opt/stack/data/nova/instances/b90e98c7-3949-4b69-80c7-2a5b85bc88a3_del complete
Nov 27 03:27:33 user nova-compute[75006]: INFO nova.compute.manager [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 27 03:27:33 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received event network-vif-unplugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] No waiting events found dispatching network-vif-unplugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received event network-vif-unplugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received event network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] Acquiring lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] No waiting events found dispatching network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:33 user nova-compute[75006]: WARNING nova.compute.manager [req-012030d4-5ad2-482f-8271-529acd754cd6 req-fd79efe8-b3e0-442f-a9e9-46e93653d80c service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received unexpected event network-vif-plugged-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec for instance with vm_state active and task_state deleting.
Nov 27 03:27:34 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:34 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Took 0.86 seconds to deallocate network for instance.
Nov 27 03:27:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:34 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:34 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:34 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Deleted allocations for instance b90e98c7-3949-4b69-80c7-2a5b85bc88a3
Nov 27 03:27:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-256423f7-6053-47b6-afdd-801d214933c8 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "b90e98c7-3949-4b69-80c7-2a5b85bc88a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-d6541e39-eea6-438c-834f-da5103959c65 req-23253981-3f6f-4dcb-bca4-4cff17d199da service nova] [instance: b90e98c7-3949-4b69-80c7-2a5b85bc88a3] Received event network-vif-deleted-aaa662b2-e109-4a0a-9d8d-2d6e2734dfec {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:36 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:27:37 user nova-compute[75006]: INFO nova.compute.claims [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Claim successful on node user
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:27:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.policy [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24fcf1d84af04fa09278a318510fe6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4cdd7f6a9244a1d825cda5b92610432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:27:37 user nova-compute[75006]: INFO nova.virt.block_device [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Booting with volume 2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 at /dev/vda
Nov 27 03:27:37 user nova-compute[75006]: DEBUG os_brick.utils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[527a51ff-c1d0-4a73-ac93-9098024eac36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11006dc-7046-48b8-ac51-326c9e504274]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e169d80-cf6b-4d21-948e-bb30ffd65f26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc9cfa0-30d9-4868-be6c-41fdbb393587]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:27:37 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:27:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33d97db-75fe-4fa3-814a-4048c944aa7c]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG os_brick.utils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:37 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating existing volume attachment record: 0cdfba82-c618-4e82-a885-0b37c9d7ee10 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:27:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:38 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Successfully created port: e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:27:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Successfully updated port: e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquired lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfbebc8f-dbbf-41bf-a495-963ee3622feb req-b138c863-e0ca-49b1-ad43-8f39e4b9841c service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfbebc8f-dbbf-41bf-a495-963ee3622feb req-b138c863-e0ca-49b1-ad43-8f39e4b9841c service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing instance network info cache due to event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfbebc8f-dbbf-41bf-a495-963ee3622feb req-b138c863-e0ca-49b1-ad43-8f39e4b9841c service nova] Acquiring lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Releasing lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance network_info: |[{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfbebc8f-dbbf-41bf-a495-963ee3622feb req-b138c863-e0ca-49b1-ad43-8f39e4b9841c service nova] Acquired lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:27:39 user nova-compute[75006]: DEBUG nova.network.neutron [req-cfbebc8f-dbbf-41bf-a495-963ee3622feb req-b138c863-e0ca-49b1-ad43-8f39e4b9841c service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:27:40 user nova-compute[75006]: DEBUG nova.network.neutron [req-cfbebc8f-dbbf-41bf-a495-963ee3622feb req-b138c863-e0ca-49b1-ad43-8f39e4b9841c service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updated VIF entry in instance network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:27:40 user nova-compute[75006]: DEBUG nova.network.neutron [req-cfbebc8f-dbbf-41bf-a495-963ee3622feb req-b138c863-e0ca-49b1-ad43-8f39e4b9841c service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfbebc8f-dbbf-41bf-a495-963ee3622feb req-b138c863-e0ca-49b1-ad43-8f39e4b9841c service nova] Releasing lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:27:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:27:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:27:41 user nova-compute[75006]: INFO nova.compute.claims [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Claim successful on node user
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:27:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.policy [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6153e4e893d74cdcae25fae6db9fc589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891478cee7d4a89bd27cd45a9732ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:27:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Creating image(s)
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Successfully created port: 391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk 1073741824" returned: 0 in 0.051s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Cannot resize image /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Ensure instance console log exists: /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Successfully updated port: 391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquired lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-55476f9c-4c39-4df7-a9aa-0a05b1c53467 req-363805dc-f874-4c86-ada6-40692c6da3c6 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-changed-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-55476f9c-4c39-4df7-a9aa-0a05b1c53467 req-363805dc-f874-4c86-ada6-40692c6da3c6 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Refreshing instance network info cache due to event network-changed-391a7fa7-53fe-41fc-a6c1-e49603ea7c96. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-55476f9c-4c39-4df7-a9aa-0a05b1c53467 req-363805dc-f874-4c86-ada6-40692c6da3c6 service nova] Acquiring lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating instance_info_cache with network_info: [{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Releasing lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance network_info: |[{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-55476f9c-4c39-4df7-a9aa-0a05b1c53467 req-363805dc-f874-4c86-ada6-40692c6da3c6 service nova] Acquired lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:27:43 user nova-compute[75006]: DEBUG nova.network.neutron [req-55476f9c-4c39-4df7-a9aa-0a05b1c53467 req-363805dc-f874-4c86-ada6-40692c6da3c6 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Refreshing network info cache for port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Start _get_guest_xml network_info=[{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:27:44 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:27:44 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-663731875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-663731875',id=27,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2c2VFlgBpGIwKezBrl602UeEXzR+Dbjd2U7k8O4/faonkz0iODXczWyuPBBZpYsA9dCmpvs95jW1H4duBhY91uajCGryA/XBUhb+0JFKyJbhTZ+vCbRL5JtWceoCcMUw==',key_name='tempest-keypair-720199553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-awbkwbnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:27:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=1556b696-96e5-4cd6-9246-3673235d47fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'pci_devices' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:27:44 user nova-compute[75006]:   <uuid>1556b696-96e5-4cd6-9246-3673235d47fc</uuid>
Nov 27 03:27:44 user nova-compute[75006]:   <name>instance-0000001b</name>
Nov 27 03:27:44 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:27:44 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:27:44 user nova-compute[75006]:   <metadata>
Nov 27 03:27:44 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:27:44 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:27:44 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-663731875</nova:name>
Nov 27 03:27:44 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:27:44</nova:creationTime>
Nov 27 03:27:44 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:27:44 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:27:44 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:27:44 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:27:44 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:27:44 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:27:44 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:27:44 user nova-compute[75006]:       <nova:owner>
Nov 27 03:27:44 user nova-compute[75006]:         <nova:user uuid="6153e4e893d74cdcae25fae6db9fc589">tempest-AttachVolumeShelveTestJSON-392586266-project-member</nova:user>
Nov 27 03:27:44 user nova-compute[75006]:         <nova:project uuid="8891478cee7d4a89bd27cd45a9732ac9">tempest-AttachVolumeShelveTestJSON-392586266</nova:project>
Nov 27 03:27:44 user nova-compute[75006]:       </nova:owner>
Nov 27 03:27:44 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:27:44 user nova-compute[75006]:       <nova:ports>
Nov 27 03:27:44 user nova-compute[75006]:         <nova:port uuid="391a7fa7-53fe-41fc-a6c1-e49603ea7c96">
Nov 27 03:27:44 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 27 03:27:44 user nova-compute[75006]:         </nova:port>
Nov 27 03:27:44 user nova-compute[75006]:       </nova:ports>
Nov 27 03:27:44 user nova-compute[75006]:     </nova:instance>
Nov 27 03:27:44 user nova-compute[75006]:   </metadata>
Nov 27 03:27:44 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:27:44 user nova-compute[75006]:     <system>
Nov 27 03:27:44 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:27:44 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:27:44 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:27:44 user nova-compute[75006]:       <entry name="serial">1556b696-96e5-4cd6-9246-3673235d47fc</entry>
Nov 27 03:27:44 user nova-compute[75006]:       <entry name="uuid">1556b696-96e5-4cd6-9246-3673235d47fc</entry>
Nov 27 03:27:44 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:27:44 user nova-compute[75006]:     </system>
Nov 27 03:27:44 user nova-compute[75006]:   </sysinfo>
Nov 27 03:27:44 user nova-compute[75006]:   <os>
Nov 27 03:27:44 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:27:44 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:27:44 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:27:44 user nova-compute[75006]:   </os>
Nov 27 03:27:44 user nova-compute[75006]:   <features>
Nov 27 03:27:44 user nova-compute[75006]:     <acpi/>
Nov 27 03:27:44 user nova-compute[75006]:     <apic/>
Nov 27 03:27:44 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:27:44 user nova-compute[75006]:   </features>
Nov 27 03:27:44 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:27:44 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:27:44 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:27:44 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:27:44 user nova-compute[75006]:   </clock>
Nov 27 03:27:44 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:27:44 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:27:44 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:27:44 user nova-compute[75006]:   </cpu>
Nov 27 03:27:44 user nova-compute[75006]:   <devices>
Nov 27 03:27:44 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:27:44 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:27:44 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk"/>
Nov 27 03:27:44 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:27:44 user nova-compute[75006]:     </disk>
Nov 27 03:27:44 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:27:44 user nova-compute[75006]:       <mac address="fa:16:3e:dd:8b:c2"/>
Nov 27 03:27:44 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:27:44 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:27:44 user nova-compute[75006]:       <target dev="tap391a7fa7-53"/>
Nov 27 03:27:44 user nova-compute[75006]:     </interface>
Nov 27 03:27:44 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:27:44 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/console.log" append="off"/>
Nov 27 03:27:44 user nova-compute[75006]:     </serial>
Nov 27 03:27:44 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:27:44 user nova-compute[75006]:     <video>
Nov 27 03:27:44 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:27:44 user nova-compute[75006]:     </video>
Nov 27 03:27:44 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:27:44 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:27:44 user nova-compute[75006]:     </rng>
Nov 27 03:27:44 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:27:44 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:27:44 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:27:44 user nova-compute[75006]:     </memballoon>
Nov 27 03:27:44 user nova-compute[75006]:   </devices>
Nov 27 03:27:44 user nova-compute[75006]: </domain>
Nov 27 03:27:44 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-663731875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-663731875',id=27,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2c2VFlgBpGIwKezBrl602UeEXzR+Dbjd2U7k8O4/faonkz0iODXczWyuPBBZpYsA9dCmpvs95jW1H4duBhY91uajCGryA/XBUhb+0JFKyJbhTZ+vCbRL5JtWceoCcMUw==',key_name='tempest-keypair-720199553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-awbkwbnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:27:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=1556b696-96e5-4cd6-9246-3673235d47fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_vif [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e171bc61-6d51-5898-be59-2cdd728c792c', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap391a7fa7-53, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap391a7fa7-53, col_values=(('qos', UUID('7791cffd-c607-4c54-b8ca-efcd73390479')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap391a7fa7-53, col_values=(('external_ids', {'iface-id': '391a7fa7-53fe-41fc-a6c1-e49603ea7c96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:8b:c2', 'vm-uuid': '1556b696-96e5-4cd6-9246-3673235d47fc'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:44 user nova-compute[75006]: INFO os_vif [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53')
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No VIF found with MAC fa:16:3e:dd:8b:c2, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:27:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Creating image(s)
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Ensure instance console log exists: /opt/stack/data/nova/instances/67512cf7-e06d-406e-ad8b-fcfd6fbbb472/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Start _get_guest_xml network_info=[{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '0cdfba82-c618-4e82-a885-0b37c9d7ee10', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJijpCdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67512cf7-e06d-406e-ad8b-fcfd6fbbb472', 'attached_at': '', 'detached_at': '', 'volume_id': '2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'serial': '2ae6deb1-eb3e-4ecf-81d6-86c36412cee0'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:27:44 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:27:44 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJijpCdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:44 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe06b09b-0e94-424d-a4e0-f16f190e28c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:27:44 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee8b73-a5db-4099-ba4d-f76798c0a467]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0] added
Nov 27 03:27:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6520a3c1-7dc6-45b1-b5a0-f54ec1757c14]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7397d31c-5ad0-4588-949e-1c14daff0524]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJijpCdg {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJijpCdg" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[050c679e-3449-4a99-8b55-bc6b069920b3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJijpCdg'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[814416e6-6f59-4743-be4e-fc8e14853b6d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-55476f9c-4c39-4df7-a9aa-0a05b1c53467 req-363805dc-f874-4c86-ada6-40692c6da3c6 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updated VIF entry in instance network info cache for port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-55476f9c-4c39-4df7-a9aa-0a05b1c53467 req-363805dc-f874-4c86-ada6-40692c6da3c6 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating instance_info_cache with network_info: [{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-55476f9c-4c39-4df7-a9aa-0a05b1c53467 req-363805dc-f874-4c86-ada6-40692c6da3c6 service nova] Releasing lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c461a8c5-54b5-423e-8d9a-c140de236917]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4f791a-1671-4c3b-a5dc-496d1b468e96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260]
Nov 27 03:27:44 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260] successful.
Nov 27 03:27:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee519408-982c-459c-9314-42cd549f123e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a70e36-a5c5-4cb3-8a6b-c0e46b14f9d4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:44 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:27:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a8631-f1f3-44da-b68e-2e1619960d20]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJijpCdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23962346135393162', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962346135393162', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1350526478',display_name='tempest-TestShelveInstance-server-1350526478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1350526478',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlQSNuDrUjejO0Gh0EnVAdJHDpXJSubJx7mrtBILqMgeIwPMdBqlx3c/VqejDgOvDMNN3L0QqSQDY4OZx8knM+Umllig6NVhbmKGxLaxDgBM3MYpnCYIWlWsHwT/gfSZA==',key_name='tempest-TestShelveInstance-800573928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4cdd7f6a9244a1d825cda5b92610432',ramdisk_id='',reservation_id='r-oh2aae0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-313467041',owner_user_name='tempest-TestShelveInstance-313467041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:27:38Z,user_data=None,user_id='24fcf1d84af04fa09278a318510fe6fd',uuid=67512cf7-e06d-406e-ad8b-fcfd6fbbb472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converting VIF {"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lazy-loading 'pci_devices' on Instance uuid 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:27:45 user nova-compute[75006]:   <uuid>67512cf7-e06d-406e-ad8b-fcfd6fbbb472</uuid>
Nov 27 03:27:45 user nova-compute[75006]:   <name>instance-0000001a</name>
Nov 27 03:27:45 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:27:45 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:27:45 user nova-compute[75006]:   <metadata>
Nov 27 03:27:45 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:27:45 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:27:45 user nova-compute[75006]:       <nova:name>tempest-TestShelveInstance-server-1350526478</nova:name>
Nov 27 03:27:45 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:27:44</nova:creationTime>
Nov 27 03:27:45 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:27:45 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:27:45 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:27:45 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:27:45 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:27:45 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:27:45 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:27:45 user nova-compute[75006]:       <nova:owner>
Nov 27 03:27:45 user nova-compute[75006]:         <nova:user uuid="24fcf1d84af04fa09278a318510fe6fd">tempest-TestShelveInstance-313467041-project-member</nova:user>
Nov 27 03:27:45 user nova-compute[75006]:         <nova:project uuid="c4cdd7f6a9244a1d825cda5b92610432">tempest-TestShelveInstance-313467041</nova:project>
Nov 27 03:27:45 user nova-compute[75006]:       </nova:owner>
Nov 27 03:27:45 user nova-compute[75006]:       <nova:ports>
Nov 27 03:27:45 user nova-compute[75006]:         <nova:port uuid="e5137b18-6b9a-4ee0-af15-45581ed243c2">
Nov 27 03:27:45 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:27:45 user nova-compute[75006]:         </nova:port>
Nov 27 03:27:45 user nova-compute[75006]:       </nova:ports>
Nov 27 03:27:45 user nova-compute[75006]:     </nova:instance>
Nov 27 03:27:45 user nova-compute[75006]:   </metadata>
Nov 27 03:27:45 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:27:45 user nova-compute[75006]:     <system>
Nov 27 03:27:45 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:27:45 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:27:45 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:27:45 user nova-compute[75006]:       <entry name="serial">67512cf7-e06d-406e-ad8b-fcfd6fbbb472</entry>
Nov 27 03:27:45 user nova-compute[75006]:       <entry name="uuid">67512cf7-e06d-406e-ad8b-fcfd6fbbb472</entry>
Nov 27 03:27:45 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:27:45 user nova-compute[75006]:     </system>
Nov 27 03:27:45 user nova-compute[75006]:   </sysinfo>
Nov 27 03:27:45 user nova-compute[75006]:   <os>
Nov 27 03:27:45 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:27:45 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:27:45 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:27:45 user nova-compute[75006]:   </os>
Nov 27 03:27:45 user nova-compute[75006]:   <features>
Nov 27 03:27:45 user nova-compute[75006]:     <acpi/>
Nov 27 03:27:45 user nova-compute[75006]:     <apic/>
Nov 27 03:27:45 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:27:45 user nova-compute[75006]:   </features>
Nov 27 03:27:45 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:27:45 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:27:45 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:27:45 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:27:45 user nova-compute[75006]:   </clock>
Nov 27 03:27:45 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:27:45 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:27:45 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:27:45 user nova-compute[75006]:   </cpu>
Nov 27 03:27:45 user nova-compute[75006]:   <devices>
Nov 27 03:27:45 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:27:45 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:27:45 user nova-compute[75006]:       <source dev="/dev/sdb"/>
Nov 27 03:27:45 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:27:45 user nova-compute[75006]:       <serial>2ae6deb1-eb3e-4ecf-81d6-86c36412cee0</serial>
Nov 27 03:27:45 user nova-compute[75006]:     </disk>
Nov 27 03:27:45 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:27:45 user nova-compute[75006]:       <mac address="fa:16:3e:4c:d6:07"/>
Nov 27 03:27:45 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:27:45 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:27:45 user nova-compute[75006]:       <target dev="tape5137b18-6b"/>
Nov 27 03:27:45 user nova-compute[75006]:     </interface>
Nov 27 03:27:45 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:27:45 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/67512cf7-e06d-406e-ad8b-fcfd6fbbb472/console.log" append="off"/>
Nov 27 03:27:45 user nova-compute[75006]:     </serial>
Nov 27 03:27:45 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:27:45 user nova-compute[75006]:     <video>
Nov 27 03:27:45 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:27:45 user nova-compute[75006]:     </video>
Nov 27 03:27:45 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:27:45 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:27:45 user nova-compute[75006]:     </rng>
Nov 27 03:27:45 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:27:45 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:27:45 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:27:45 user nova-compute[75006]:     </memballoon>
Nov 27 03:27:45 user nova-compute[75006]:   </devices>
Nov 27 03:27:45 user nova-compute[75006]: </domain>
Nov 27 03:27:45 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1350526478',display_name='tempest-TestShelveInstance-server-1350526478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1350526478',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlQSNuDrUjejO0Gh0EnVAdJHDpXJSubJx7mrtBILqMgeIwPMdBqlx3c/VqejDgOvDMNN3L0QqSQDY4OZx8knM+Umllig6NVhbmKGxLaxDgBM3MYpnCYIWlWsHwT/gfSZA==',key_name='tempest-TestShelveInstance-800573928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4cdd7f6a9244a1d825cda5b92610432',ramdisk_id='',reservation_id='r-oh2aae0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-313467041',owner_user_name='tempest-TestShelveInstance-313467041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:27:38Z,user_data=None,user_id='24fcf1d84af04fa09278a318510fe6fd',uuid=67512cf7-e06d-406e-ad8b-fcfd6fbbb472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converting VIF {"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG os_vif [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26684faf-f3a8-508b-a0e9-3b1cfdedf3ed', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5137b18-6b, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5137b18-6b, col_values=(('qos', UUID('34d8ed10-e218-4287-b00b-6778564f92e0')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5137b18-6b, col_values=(('external_ids', {'iface-id': 'e5137b18-6b9a-4ee0-af15-45581ed243c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:d6:07', 'vm-uuid': '67512cf7-e06d-406e-ad8b-fcfd6fbbb472'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-e2bbe1df-0a85-4696-bc98-0dbac18099ed req-28e5e786-26b9-4132-9c11-ef2ab3e7e479 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2bbe1df-0a85-4696-bc98-0dbac18099ed req-28e5e786-26b9-4132-9c11-ef2ab3e7e479 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2bbe1df-0a85-4696-bc98-0dbac18099ed req-28e5e786-26b9-4132-9c11-ef2ab3e7e479 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2bbe1df-0a85-4696-bc98-0dbac18099ed req-28e5e786-26b9-4132-9c11-ef2ab3e7e479 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-e2bbe1df-0a85-4696-bc98-0dbac18099ed req-28e5e786-26b9-4132-9c11-ef2ab3e7e479 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:45 user nova-compute[75006]: WARNING nova.compute.manager [req-e2bbe1df-0a85-4696-bc98-0dbac18099ed req-28e5e786-26b9-4132-9c11-ef2ab3e7e479 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state building and task_state spawning.
Nov 27 03:27:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:45 user nova-compute[75006]: INFO os_vif [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b')
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] No VIF found with MAC fa:16:3e:4c:d6:07, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.network.neutron [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Port 01db2ae6-9b70-456e-aaa3-ecec258c0a00 binding to destination host user is already ACTIVE {{(pid=75006) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquired lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:27:45 user nova-compute[75006]: DEBUG nova.network.neutron [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG nova.network.neutron [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Releasing lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Creating tmpfile /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/tmpv92hu54n to verify with other compute node that the instance is on the same shared storage. {{(pid=75006) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-8ccefe33-d498-4533-a08e-185b3b59c9db req-5b30e7aa-6b90-44ca-9882-71b15fb06dac service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8ccefe33-d498-4533-a08e-185b3b59c9db req-5b30e7aa-6b90-44ca-9882-71b15fb06dac service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8ccefe33-d498-4533-a08e-185b3b59c9db req-5b30e7aa-6b90-44ca-9882-71b15fb06dac service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8ccefe33-d498-4533-a08e-185b3b59c9db req-5b30e7aa-6b90-44ca-9882-71b15fb06dac service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-8ccefe33-d498-4533-a08e-185b3b59c9db req-5b30e7aa-6b90-44ca-9882-71b15fb06dac service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:46 user nova-compute[75006]: WARNING nova.compute.manager [req-8ccefe33-d498-4533-a08e-185b3b59c9db req-5b30e7aa-6b90-44ca-9882-71b15fb06dac service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state resized and task_state resize_reverting.
Nov 27 03:27:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:47 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance destroyed successfully.
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.objects.instance [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lazy-loading 'resources' on Instance uuid e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_vif [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01db2ae6-9b, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61f43703-7831-4939-872d-3d4da56a9af0) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:47 user nova-compute[75006]: INFO os_vif [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b')
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:47 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[664b1194-321b-45d4-9341-8e3933104edf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:27:47 user nova-compute[75006]: No targets found.
Nov 27 03:27:47 user nova-compute[75006]: iSNS:
Nov 27 03:27:47 user nova-compute[75006]: No targets found.
Nov 27 03:27:47 user nova-compute[75006]: STATIC:
Nov 27 03:27:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431
Nov 27 03:27:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:27:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:27:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6
Nov 27 03:27:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:47 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0
Nov 27 03:27:47 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:27:47 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:27:47 user nova-compute[75006]: FIRMWARE:
Nov 27 03:27:47 user nova-compute[75006]: No targets found.
Nov 27 03:27:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:27:47 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:27:47 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea479f4-a18b-41d3-832f-347c8efb2feb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d57ba0-76ab-4fbb-9778-8e3a1b192b5e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:47 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:47 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:47 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:47 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:27:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:47 user nova-compute[75006]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:47 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:47 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:47 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:27:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c2ce3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341697f-4b5e-40e9-9024-3d905fab3cb3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c2538b-50a6-4cb4-9d21-984e82e5bcac]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01cba7e-d499-4c3f-864c-2e9b75258532]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.069s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2935167b-427b-43f8-913f-5e0e06857806]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:47 user nova-compute[75006]: WARNING nova.compute.manager [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state building and task_state spawning.
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] No waiting events found dispatching network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:47 user nova-compute[75006]: WARNING nova.compute.manager [req-26f8e841-fa66-437c-901d-48d508b66472 req-f054e071-6cfb-4e4c-aa97-7c5e021e80e9 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received unexpected event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 for instance with vm_state building and task_state spawning.
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b14061-ee11-4dd4-9ae1-0e61814c9133]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:27:47 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance spawned successfully.
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[857d6b31-51ad-48fc-982d-e17c1a930a6b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]
Nov 27 03:27:47 user nova-compute[75006]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.
Nov 27 03:27:47 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d1974c-1c85-4315-adbf-e458749d16ab]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== disconnect_volume: return (435ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:27:48 user nova-compute[75006]: INFO nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 27 03:27:48 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:27:48 user nova-compute[75006]: INFO nova.compute.manager [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Took 6.19 seconds to build instance.
Nov 27 03:27:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c8798d6e-160d-4c6a-af72-ee79dcae4337 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.309s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-8cb5d327-b46b-4208-ae7c-8f33be211593 req-fd2fafb4-b1c6-48f6-8ff1-2da93afa8bba service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8cb5d327-b46b-4208-ae7c-8f33be211593 req-fd2fafb4-b1c6-48f6-8ff1-2da93afa8bba service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8cb5d327-b46b-4208-ae7c-8f33be211593 req-fd2fafb4-b1c6-48f6-8ff1-2da93afa8bba service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8cb5d327-b46b-4208-ae7c-8f33be211593 req-fd2fafb4-b1c6-48f6-8ff1-2da93afa8bba service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-8cb5d327-b46b-4208-ae7c-8f33be211593 req-fd2fafb4-b1c6-48f6-8ff1-2da93afa8bba service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:48 user nova-compute[75006]: WARNING nova.compute.manager [req-8cb5d327-b46b-4208-ae7c-8f33be211593 req-fd2fafb4-b1c6-48f6-8ff1-2da93afa8bba service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state resized and task_state resize_reverting.
Nov 27 03:27:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG nova.objects.instance [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lazy-loading 'migration_context' on Instance uuid e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:48 user nova-compute[75006]: DEBUG nova.objects.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Object Instance<e8860f63-c6ce-43ee-8c6e-6eea89d901d1> lazy-loaded attributes: resources,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.581s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:49 user nova-compute[75006]: INFO nova.compute.manager [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Terminating instance
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:27:49 user nova-compute[75006]: INFO nova.compute.manager [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Swapping old allocation on dict_keys(['b7ca9733-4bfc-461c-abb4-2c38c7e215cd']) held by migration b695dec7-47e0-43c3-baf4-14dd85effaf2 for instance
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Overwriting current allocation {'allocations': {'b7ca9733-4bfc-461c-abb4-2c38c7e215cd': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 31}}, 'project_id': '00ce3c8acb7748f8af5dce8fc3f02ebe', 'user_id': '8df2fba5f3724b2fb210eef7331a2dcd', 'consumer_generation': 1} on consumer e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-da5c0ef0-ab5e-4e70-bb59-70b957629aa0 req-19d1c32b-6909-4700-9d5e-8434cb27951f service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da5c0ef0-ab5e-4e70-bb59-70b957629aa0 req-19d1c32b-6909-4700-9d5e-8434cb27951f service nova] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da5c0ef0-ab5e-4e70-bb59-70b957629aa0 req-19d1c32b-6909-4700-9d5e-8434cb27951f service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da5c0ef0-ab5e-4e70-bb59-70b957629aa0 req-19d1c32b-6909-4700-9d5e-8434cb27951f service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-da5c0ef0-ab5e-4e70-bb59-70b957629aa0 req-19d1c32b-6909-4700-9d5e-8434cb27951f service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] No waiting events found dispatching network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:49 user nova-compute[75006]: WARNING nova.compute.manager [req-da5c0ef0-ab5e-4e70-bb59-70b957629aa0 req-19d1c32b-6909-4700-9d5e-8434cb27951f service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received unexpected event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 for instance with vm_state building and task_state spawning.
Nov 27 03:27:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:27:49 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance spawned successfully.
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:27:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:50 user nova-compute[75006]: INFO nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:27:50 user nova-compute[75006]: INFO nova.compute.manager [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Took 13.18 seconds to build instance.
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e1fdd47a-ae93-4f2a-8ae3-486b19297c84 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.298s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquired lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.network.neutron [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:27:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Instance destroyed successfully.
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'resources' on Instance uuid 70a4bf10-12f0-4b99-baa2-53be7becbb21 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1573842622',display_name='tempest-AttachVolumeTestJSON-server-1573842622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1573842622',id=3,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAinorr3mRl+TnNwmZnA6DHjEgYUr1ckBl6GCFNTPdLCb9SkjrzXV5FFpt7/GpkIsLNx2YZG8/Ck26ubRc32g97umgM0jf0K+KtgIzDxEloaKnY+MdYOai3zohg43LyYQ==',key_name='tempest-keypair-196716598',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-yboh7sej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=70a4bf10-12f0-4b99-baa2-53be7becbb21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "address": "fa:16:3e:1a:de:2b", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f7e81ab-18", "ovs_interfaceid": "1f7e81ab-1878-407b-a8fe-02ea2918ff76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG os_vif [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f7e81ab-18, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a125192b-1179-4332-b057-fbca812ec6db) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:50 user nova-compute[75006]: INFO os_vif [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:de:2b,bridge_name='br-int',has_traffic_filtering=True,id=1f7e81ab-1878-407b-a8fe-02ea2918ff76,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f7e81ab-18')
Nov 27 03:27:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Deleting instance files /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21_del
Nov 27 03:27:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Deletion of /opt/stack/data/nova/instances/70a4bf10-12f0-4b99-baa2-53be7becbb21_del complete
Nov 27 03:27:50 user nova-compute[75006]: INFO nova.compute.manager [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG nova.network.neutron [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Releasing lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG os_brick.utils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[64020e38-b221-4204-afef-ec35a43a1552]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[494a76db-9dde-4452-afe6-dbcdf7958ef0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[278e4e75-1e4e-4e53-b0f8-1122e0da6419]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a7085-b365-4015-9842-19d118a9d3b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:27:51 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[65821821-9a18-40d1-9dba-8579120c5f7a]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG os_brick.utils [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:51 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Error from libvirt while getting description of instance-00000003: [Error Code 42] Domain not found: no domain with matching uuid '70a4bf10-12f0-4b99-baa2-53be7becbb21' (instance-00000003): libvirt.libvirtError: Domain not found: no domain with matching uuid '70a4bf10-12f0-4b99-baa2-53be7becbb21' (instance-00000003)
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-unplugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] Acquiring lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] No waiting events found dispatching network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:51 user nova-compute[75006]: WARNING nova.compute.manager [req-748a6024-a1b0-4843-a297-18fc632ed7f6 req-8aaf1c64-ca14-4c76-a051-f37143a85cd1 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received unexpected event network-vif-plugged-1f7e81ab-1878-407b-a8fe-02ea2918ff76 for instance with vm_state active and task_state deleting.
Nov 27 03:27:51 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-86bb0e04-1a9b-47ca-adda-6c56a05fe0a0 req-b2f02f3e-9279-49a3-925b-b4748f3c3134 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Received event network-vif-deleted-1f7e81ab-1878-407b-a8fe-02ea2918ff76 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:52 user nova-compute[75006]: INFO nova.compute.manager [req-86bb0e04-1a9b-47ca-adda-6c56a05fe0a0 req-b2f02f3e-9279-49a3-925b-b4748f3c3134 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Neutron deleted interface 1f7e81ab-1878-407b-a8fe-02ea2918ff76; detaching it from the instance and deleting it from the info cache
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-86bb0e04-1a9b-47ca-adda-6c56a05fe0a0 req-b2f02f3e-9279-49a3-925b-b4748f3c3134 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:52 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Took 1.30 seconds to deallocate network for instance.
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-86bb0e04-1a9b-47ca-adda-6c56a05fe0a0 req-b2f02f3e-9279-49a3-925b-b4748f3c3134 service nova] [instance: 70a4bf10-12f0-4b99-baa2-53be7becbb21] Detach interface failed, port_id=1f7e81ab-1878-407b-a8fe-02ea2918ff76, reason: Instance 70a4bf10-12f0-4b99-baa2-53be7becbb21 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:52 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Deleted allocations for instance 70a4bf10-12f0-4b99-baa2-53be7becbb21
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6322c20c-8064-441c-adfc-87d49af33687 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "70a4bf10-12f0-4b99-baa2-53be7becbb21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:54 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:27:54 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7770MB free_disk=25.416614532470703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 32bf5b72-4409-4608-b933-8aa4b99e95ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 90630ecf-9ed5-47cc-b7b9-b313ed57e46f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 1556b696-96e5-4cd6-9246-3673235d47fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:54 user nova-compute[75006]: INFO nova.compute.manager [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Terminating instance
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-c38db3eb-6419-4daa-8bd6-4192c358953b req-72fb6df3-0fc5-4894-92de-96fcf6d645dc service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received event network-vif-unplugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c38db3eb-6419-4daa-8bd6-4192c358953b req-72fb6df3-0fc5-4894-92de-96fcf6d645dc service nova] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c38db3eb-6419-4daa-8bd6-4192c358953b req-72fb6df3-0fc5-4894-92de-96fcf6d645dc service nova] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c38db3eb-6419-4daa-8bd6-4192c358953b req-72fb6df3-0fc5-4894-92de-96fcf6d645dc service nova] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-c38db3eb-6419-4daa-8bd6-4192c358953b req-72fb6df3-0fc5-4894-92de-96fcf6d645dc service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] No waiting events found dispatching network-vif-unplugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-c38db3eb-6419-4daa-8bd6-4192c358953b req-72fb6df3-0fc5-4894-92de-96fcf6d645dc service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received event network-vif-unplugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:27:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Instance destroyed successfully.
Nov 27 03:27:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lazy-loading 'resources' on Instance uuid 32bf5b72-4409-4608-b933-8aa4b99e95ab {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-378212485',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-378212485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3782124',id=23,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYQ57exQ6SkqrDk16gPOny/Q4Z0dRl0kVyAdhgxR1aleu7MsfYdZfTGPrlbHc6dgmiHrRqWXwsodMtk36nr7z0A6O+M/3MvU39JA96yfEOvy3RKSrMQaWWAZ9E9OPgVDg==',key_name='tempest-keypair-287732440',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:24:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc67e44d4444f8d8ac93ff4999c4207',ramdisk_id='',reservation_id='r-y1du30j8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2143182561',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c27190ecebf849039f453bcce444effa',uuid=32bf5b72-4409-4608-b933-8aa4b99e95ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Converting VIF {"id": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "address": "fa:16:3e:8e:26:5b", "network": {"id": "3b5cf380-8539-4be2-8292-ee5abfc5bb52", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1374272585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc67e44d4444f8d8ac93ff4999c4207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fb8696-51", "ovs_interfaceid": "63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:5b,bridge_name='br-int',has_traffic_filtering=True,id=63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9,network=Network(3b5cf380-8539-4be2-8292-ee5abfc5bb52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fb8696-51') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG os_vif [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:5b,bridge_name='br-int',has_traffic_filtering=True,id=63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9,network=Network(3b5cf380-8539-4be2-8292-ee5abfc5bb52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fb8696-51') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63fb8696-51, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeb0916e-beda-4c2d-9c06-0ce4fd15d170) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:27:55 user nova-compute[75006]: INFO os_vif [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:26:5b,bridge_name='br-int',has_traffic_filtering=True,id=63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9,network=Network(3b5cf380-8539-4be2-8292-ee5abfc5bb52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fb8696-51')
Nov 27 03:27:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Deleting instance files /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab_del
Nov 27 03:27:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Deletion of /opt/stack/data/nova/instances/32bf5b72-4409-4608-b933-8aa4b99e95ab_del complete
Nov 27 03:27:55 user nova-compute[75006]: INFO nova.compute.manager [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 03:27:55 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-206f9bb6-73e7-4311-bbc0-8322e8d4f810 req-3805af64-d2ab-409e-b93a-205b8b353f7c service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received event network-vif-deleted-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:56 user nova-compute[75006]: INFO nova.compute.manager [req-206f9bb6-73e7-4311-bbc0-8322e8d4f810 req-3805af64-d2ab-409e-b93a-205b8b353f7c service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Neutron deleted interface 63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9; detaching it from the instance and deleting it from the info cache
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.network.neutron [req-206f9bb6-73e7-4311-bbc0-8322e8d4f810 req-3805af64-d2ab-409e-b93a-205b8b353f7c service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:56 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Took 0.87 seconds to deallocate network for instance.
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-206f9bb6-73e7-4311-bbc0-8322e8d4f810 req-3805af64-d2ab-409e-b93a-205b8b353f7c service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Detach interface failed, port_id=63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9, reason: Instance 32bf5b72-4409-4608-b933-8aa4b99e95ab could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-e8860f63-c6ce-43ee-8c6e-6eea89d901d1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:56 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Deleted allocations for instance 32bf5b72-4409-4608-b933-8aa4b99e95ab
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-340c25b3-8a10-4959-8f8d-a42e4681f04b req-ca9ee4a9-00c7-442c-8f5d-eff6799fd282 service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received event network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-340c25b3-8a10-4959-8f8d-a42e4681f04b req-ca9ee4a9-00c7-442c-8f5d-eff6799fd282 service nova] Acquiring lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-340c25b3-8a10-4959-8f8d-a42e4681f04b req-ca9ee4a9-00c7-442c-8f5d-eff6799fd282 service nova] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-340c25b3-8a10-4959-8f8d-a42e4681f04b req-ca9ee4a9-00c7-442c-8f5d-eff6799fd282 service nova] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-340c25b3-8a10-4959-8f8d-a42e4681f04b req-ca9ee4a9-00c7-442c-8f5d-eff6799fd282 service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] No waiting events found dispatching network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:27:56 user nova-compute[75006]: WARNING nova.compute.manager [req-340c25b3-8a10-4959-8f8d-a42e4681f04b req-ca9ee4a9-00c7-442c-8f5d-eff6799fd282 service nova] [instance: 32bf5b72-4409-4608-b933-8aa4b99e95ab] Received unexpected event network-vif-plugged-63fb8696-51d2-4ad2-8c7e-cb4e0ea9c9e9 for instance with vm_state deleted and task_state None.
Nov 27 03:27:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-625110cc-db5e-4583-bdd9-8acc8b6eb44d tempest-TestServerVolumeAttachScenarioOldVersion-2143182561 tempest-TestServerVolumeAttachScenarioOldVersion-2143182561-project-member] Lock "32bf5b72-4409-4608-b933-8aa4b99e95ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Starting finish_revert_migration {{(pid=75006) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Start _get_guest_xml network_info=[{"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '27609108-9ccc-4f13-aa52-339b140a8cd4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e8860f63-c6ce-43ee-8c6e-6eea89d901d1', 'attached_at': '2023-11-27T03:27:58.000000', 'detached_at': '', 'volume_id': 'be037b90-f73b-4a57-a875-6944371554e7', 'serial': 'be037b90-f73b-4a57-a875-6944371554e7'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:27:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:27:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lazy-loading 'vcpu_model' on Instance uuid e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:27:58 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:58 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:27:58 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[46729593-6f7d-43b5-8244-d3634d483610]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:27:58 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad044186-f7c1-493c-80e1-670a2adea25a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7] added
Nov 27 03:27:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6136deca-3a72-4859-b007-a58c465928de]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0996ae13-9a2d-496f-8d1d-2d5da0127eba]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqFPOaxz {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqFPOaxz" returned: 0 in 0.082s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa9d89a-4fef-46be-be71-f75de9743d4e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqFPOaxz'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffee812-13b0-4c08-b846-326c3f7ae809]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce204d9d-6685-412b-bc0d-67562163a5c8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:58 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:58 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:58 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:27:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:58 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:58 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:58 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:27:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5816d9-64d0-4593-adc1-8369b4c7b1ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]
Nov 27 03:27:58 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.
Nov 27 03:27:58 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcefdff4-c454-4850-a783-ea80e75a9851]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:58 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[911c2840-cb74-46c2-b498-d35c3136910d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:59 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:59 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:59 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:27:59 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:27:59 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:27:59 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:27:59 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:27:59 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:27:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-726c514c-225a-4bf2-ae27-65109e413765 req-5c2055f9-9ec0-4e57-97dd-781422aefebb service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-changed-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-726c514c-225a-4bf2-ae27-65109e413765 req-5c2055f9-9ec0-4e57-97dd-781422aefebb service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing instance network info cache due to event network-changed-d4cdffc5-8802-415c-8293-2371f9193bbf. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-726c514c-225a-4bf2-ae27-65109e413765 req-5c2055f9-9ec0-4e57-97dd-781422aefebb service nova] Acquiring lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-726c514c-225a-4bf2-ae27-65109e413765 req-5c2055f9-9ec0-4e57-97dd-781422aefebb service nova] Acquired lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-726c514c-225a-4bf2-ae27-65109e413765 req-5c2055f9-9ec0-4e57-97dd-781422aefebb service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Refreshing network info cache for port d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae23b5e-1418-4ef6-ba3d-c1ef95e12176]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-726c514c-225a-4bf2-ae27-65109e413765 req-5c2055f9-9ec0-4e57-97dd-781422aefebb service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updated VIF entry in instance network info cache for port d4cdffc5-8802-415c-8293-2371f9193bbf. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-726c514c-225a-4bf2-ae27-65109e413765 req-5c2055f9-9ec0-4e57-97dd-781422aefebb service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [{"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-726c514c-225a-4bf2-ae27-65109e413765 req-5c2055f9-9ec0-4e57-97dd-781422aefebb service nova] Releasing lock "refresh_cache-90630ecf-9ed5-47cc-b7b9-b313ed57e46f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:27:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23938326433366139', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326433366139', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:28:00 user nova-compute[75006]:   <uuid>e8860f63-c6ce-43ee-8c6e-6eea89d901d1</uuid>
Nov 27 03:28:00 user nova-compute[75006]:   <name>instance-00000011</name>
Nov 27 03:28:00 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:28:00 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:28:00 user nova-compute[75006]:   <metadata>
Nov 27 03:28:00 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:28:00 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:28:00 user nova-compute[75006]:       <nova:name>tempest-ServerActionsTestOtherB-server-908294320</nova:name>
Nov 27 03:28:00 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:27:58</nova:creationTime>
Nov 27 03:28:00 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:28:00 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:28:00 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:28:00 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:28:00 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:28:00 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:28:00 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:28:00 user nova-compute[75006]:       <nova:owner>
Nov 27 03:28:00 user nova-compute[75006]:         <nova:user uuid="8df2fba5f3724b2fb210eef7331a2dcd">tempest-ServerActionsTestOtherB-1115240976-project-member</nova:user>
Nov 27 03:28:00 user nova-compute[75006]:         <nova:project uuid="00ce3c8acb7748f8af5dce8fc3f02ebe">tempest-ServerActionsTestOtherB-1115240976</nova:project>
Nov 27 03:28:00 user nova-compute[75006]:       </nova:owner>
Nov 27 03:28:00 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:28:00 user nova-compute[75006]:       <nova:ports>
Nov 27 03:28:00 user nova-compute[75006]:         <nova:port uuid="01db2ae6-9b70-456e-aaa3-ecec258c0a00">
Nov 27 03:28:00 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 03:28:00 user nova-compute[75006]:         </nova:port>
Nov 27 03:28:00 user nova-compute[75006]:       </nova:ports>
Nov 27 03:28:00 user nova-compute[75006]:     </nova:instance>
Nov 27 03:28:00 user nova-compute[75006]:   </metadata>
Nov 27 03:28:00 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:28:00 user nova-compute[75006]:     <system>
Nov 27 03:28:00 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:28:00 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:28:00 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:28:00 user nova-compute[75006]:       <entry name="serial">e8860f63-c6ce-43ee-8c6e-6eea89d901d1</entry>
Nov 27 03:28:00 user nova-compute[75006]:       <entry name="uuid">e8860f63-c6ce-43ee-8c6e-6eea89d901d1</entry>
Nov 27 03:28:00 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:28:00 user nova-compute[75006]:     </system>
Nov 27 03:28:00 user nova-compute[75006]:   </sysinfo>
Nov 27 03:28:00 user nova-compute[75006]:   <os>
Nov 27 03:28:00 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:28:00 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:28:00 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:28:00 user nova-compute[75006]:   </os>
Nov 27 03:28:00 user nova-compute[75006]:   <features>
Nov 27 03:28:00 user nova-compute[75006]:     <acpi/>
Nov 27 03:28:00 user nova-compute[75006]:     <apic/>
Nov 27 03:28:00 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:28:00 user nova-compute[75006]:   </features>
Nov 27 03:28:00 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:28:00 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:28:00 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:28:00 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:28:00 user nova-compute[75006]:   </clock>
Nov 27 03:28:00 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:28:00 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:28:00 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:28:00 user nova-compute[75006]:   </cpu>
Nov 27 03:28:00 user nova-compute[75006]:   <devices>
Nov 27 03:28:00 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:28:00 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:28:00 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk"/>
Nov 27 03:28:00 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:28:00 user nova-compute[75006]:     </disk>
Nov 27 03:28:00 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:28:00 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:28:00 user nova-compute[75006]:       <source dev="/dev/sdd"/>
Nov 27 03:28:00 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:28:00 user nova-compute[75006]:       <serial>be037b90-f73b-4a57-a875-6944371554e7</serial>
Nov 27 03:28:00 user nova-compute[75006]:     </disk>
Nov 27 03:28:00 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:28:00 user nova-compute[75006]:       <mac address="fa:16:3e:d9:f7:5f"/>
Nov 27 03:28:00 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:00 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:28:00 user nova-compute[75006]:       <target dev="tap01db2ae6-9b"/>
Nov 27 03:28:00 user nova-compute[75006]:     </interface>
Nov 27 03:28:00 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:28:00 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/console.log" append="off"/>
Nov 27 03:28:00 user nova-compute[75006]:     </serial>
Nov 27 03:28:00 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:28:00 user nova-compute[75006]:     <video>
Nov 27 03:28:00 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:00 user nova-compute[75006]:     </video>
Nov 27 03:28:00 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:28:00 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:28:00 user nova-compute[75006]:     </rng>
Nov 27 03:28:00 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:28:00 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:28:00 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:28:00 user nova-compute[75006]:     </memballoon>
Nov 27 03:28:00 user nova-compute[75006]:   </devices>
Nov 27 03:28:00 user nova-compute[75006]: </domain>
Nov 27 03:28:00 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG os_vif [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f161893-a824-536b-aad9-9d3fcc9391d0', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01db2ae6-9b, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01db2ae6-9b, col_values=(('qos', UUID('74baf78a-af24-4513-964f-b22c9e6985a6')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01db2ae6-9b, col_values=(('external_ids', {'iface-id': '01db2ae6-9b70-456e-aaa3-ecec258c0a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:f7:5f', 'vm-uuid': 'e8860f63-c6ce-43ee-8c6e-6eea89d901d1'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: INFO os_vif [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b')
Nov 27 03:28:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:00 user nova-compute[75006]: INFO nova.compute.manager [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Terminating instance
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.compute.manager [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-06c1f210-9cfd-4962-98a5-377a32e37c24 req-e5a009b1-75a4-4867-afda-c491d7681d18 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-06c1f210-9cfd-4962-98a5-377a32e37c24 req-e5a009b1-75a4-4867-afda-c491d7681d18 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-06c1f210-9cfd-4962-98a5-377a32e37c24 req-e5a009b1-75a4-4867-afda-c491d7681d18 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-06c1f210-9cfd-4962-98a5-377a32e37c24 req-e5a009b1-75a4-4867-afda-c491d7681d18 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-06c1f210-9cfd-4962-98a5-377a32e37c24 req-e5a009b1-75a4-4867-afda-c491d7681d18 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-unplugged-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-06c1f210-9cfd-4962-98a5-377a32e37c24 req-e5a009b1-75a4-4867-afda-c491d7681d18 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-d4cdffc5-8802-415c-8293-2371f9193bbf for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-a88fec8f-de94-4693-8161-d00241b6e8e1 req-05004ba0-b0af-4cff-9550-35268fd493bb service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a88fec8f-de94-4693-8161-d00241b6e8e1 req-05004ba0-b0af-4cff-9550-35268fd493bb service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a88fec8f-de94-4693-8161-d00241b6e8e1 req-05004ba0-b0af-4cff-9550-35268fd493bb service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a88fec8f-de94-4693-8161-d00241b6e8e1 req-05004ba0-b0af-4cff-9550-35268fd493bb service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-a88fec8f-de94-4693-8161-d00241b6e8e1 req-05004ba0-b0af-4cff-9550-35268fd493bb service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-unplugged-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-a88fec8f-de94-4693-8161-d00241b6e8e1 req-05004ba0-b0af-4cff-9550-35268fd493bb service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-d140bf5e-3fda-494d-b8ed-e31c881b312a for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-2c263ef1-495a-4ff8-a19a-8b52b7ea8d32 req-f16fbb80-ecd3-4571-af72-3033c52d5ef6 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2c263ef1-495a-4ff8-a19a-8b52b7ea8d32 req-f16fbb80-ecd3-4571-af72-3033c52d5ef6 service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2c263ef1-495a-4ff8-a19a-8b52b7ea8d32 req-f16fbb80-ecd3-4571-af72-3033c52d5ef6 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2c263ef1-495a-4ff8-a19a-8b52b7ea8d32 req-f16fbb80-ecd3-4571-af72-3033c52d5ef6 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-2c263ef1-495a-4ff8-a19a-8b52b7ea8d32 req-f16fbb80-ecd3-4571-af72-3033c52d5ef6 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:02 user nova-compute[75006]: WARNING nova.compute.manager [req-2c263ef1-495a-4ff8-a19a-8b52b7ea8d32 req-f16fbb80-ecd3-4571-af72-3033c52d5ef6 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state resized and task_state resize_reverting.
Nov 27 03:28:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Instance destroyed successfully.
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.objects.instance [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lazy-loading 'resources' on Instance uuid 90630ecf-9ed5-47cc-b7b9-b313ed57e46f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:50:c5,bridge_name='br-int',has_traffic_filtering=True,id=d4cdffc5-8802-415c-8293-2371f9193bbf,network=Network(b58701d4-1e20-4660-a02f-5169914f6dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cdffc5-88') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:50:c5,bridge_name='br-int',has_traffic_filtering=True,id=d4cdffc5-8802-415c-8293-2371f9193bbf,network=Network(b58701d4-1e20-4660-a02f-5169914f6dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cdffc5-88') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4cdffc5-88, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15a6cf7c-ad98-40a7-8640-07054ea7aba6) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:02 user nova-compute[75006]: WARNING nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-d4cdffc5-8802-415c-8293-2371f9193bbf for instance with vm_state active and task_state deleting.
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-unplugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:02 user nova-compute[75006]: WARNING nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-ee7d4323-4c9b-42d1-b241-9808f3c8b240 for instance with vm_state active and task_state deleting.
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-unplugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:02 user nova-compute[75006]: WARNING nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-b807cd5a-c23e-4080-b147-fbf84168cfb5 for instance with vm_state active and task_state deleting.
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-unplugged-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-2c7037c4-0933-4be0-a140-616e09b84689 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:02 user nova-compute[75006]: WARNING nova.compute.manager [req-761d29bf-84cf-4dee-b37d-cd5029acdcd5 req-3e2e494a-bfd9-46a6-bffb-161c67ebafce service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-2c7037c4-0933-4be0-a140-616e09b84689 for instance with vm_state active and task_state deleting.
Nov 27 03:28:02 user nova-compute[75006]: INFO os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:50:c5,bridge_name='br-int',has_traffic_filtering=True,id=d4cdffc5-8802-415c-8293-2371f9193bbf,network=Network(b58701d4-1e20-4660-a02f-5169914f6dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4cdffc5-88')
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:31,bridge_name='br-int',has_traffic_filtering=True,id=ee7d4323-4c9b-42d1-b241-9808f3c8b240,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee7d4323-4c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:31,bridge_name='br-int',has_traffic_filtering=True,id=ee7d4323-4c9b-42d1-b241-9808f3c8b240,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee7d4323-4c') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee7d4323-4c, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19b32d34-7923-46ba-8f10-986dfd09b802) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: INFO os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:31,bridge_name='br-int',has_traffic_filtering=True,id=ee7d4323-4c9b-42d1-b241-9808f3c8b240,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee7d4323-4c')
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c6:2e,bridge_name='br-int',has_traffic_filtering=True,id=d140bf5e-3fda-494d-b8ed-e31c881b312a,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd140bf5e-3f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c6:2e,bridge_name='br-int',has_traffic_filtering=True,id=d140bf5e-3fda-494d-b8ed-e31c881b312a,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd140bf5e-3f') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd140bf5e-3f, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:03 user nova-compute[75006]: WARNING nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-d140bf5e-3fda-494d-b8ed-e31c881b312a for instance with vm_state active and task_state deleting.
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-unplugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:03 user nova-compute[75006]: WARNING nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-e4992f7c-e771-4a2d-ab98-d4043b69cd97 for instance with vm_state active and task_state deleting.
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-unplugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-unplugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Acquiring lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] No waiting events found dispatching network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:03 user nova-compute[75006]: WARNING nova.compute.manager [req-e8315fe8-ef7f-4596-9568-4c92c30c35eb req-a873c3b9-f9a8-4980-a85b-5b7c1a44d938 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received unexpected event network-vif-plugged-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 for instance with vm_state active and task_state deleting.
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28a1e397-aec0-44c1-9420-57b5a3df8c70) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: INFO os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:c6:2e,bridge_name='br-int',has_traffic_filtering=True,id=d140bf5e-3fda-494d-b8ed-e31c881b312a,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd140bf5e-3f')
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:75:94,bridge_name='br-int',has_traffic_filtering=True,id=e4992f7c-e771-4a2d-ab98-d4043b69cd97,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4992f7c-e7') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:75:94,bridge_name='br-int',has_traffic_filtering=True,id=e4992f7c-e771-4a2d-ab98-d4043b69cd97,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4992f7c-e7') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4992f7c-e7, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de3a2f7e-1119-43a8-be6c-311a62e51511) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: INFO os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:75:94,bridge_name='br-int',has_traffic_filtering=True,id=e4992f7c-e771-4a2d-ab98-d4043b69cd97,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4992f7c-e7')
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:22,bridge_name='br-int',has_traffic_filtering=True,id=94a4e019-508f-4a0c-aabb-9f71f7e9b8b2,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a4e019-50') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:22,bridge_name='br-int',has_traffic_filtering=True,id=94a4e019-508f-4a0c-aabb-9f71f7e9b8b2,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a4e019-50') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94a4e019-50, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33f11da4-4915-43bf-af38-c74b65904a20) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: INFO os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:49:22,bridge_name='br-int',has_traffic_filtering=True,id=94a4e019-508f-4a0c-aabb-9f71f7e9b8b2,network=Network(82cf4062-816d-469c-b10d-b1606bc5a344),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a4e019-50')
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c7:75,bridge_name='br-int',has_traffic_filtering=True,id=b807cd5a-c23e-4080-b147-fbf84168cfb5,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb807cd5a-c2') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c7:75,bridge_name='br-int',has_traffic_filtering=True,id=b807cd5a-c23e-4080-b147-fbf84168cfb5,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb807cd5a-c2') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb807cd5a-c2, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6da1a58-9bcf-42ee-8ef7-c66f8699a99e) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: INFO os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:c7:75,bridge_name='br-int',has_traffic_filtering=True,id=b807cd5a-c23e-4080-b147-fbf84168cfb5,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb807cd5a-c2')
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T03:26:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-169740551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-169740551',id=25,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTB/uG/TmWOGwetSDJvowC4ohlGDwNcJC9BaL42rXrN5L8JXMCy3Kugg+zhIitHSLfVBq5fZ/+BWE8uHhFnI1XpzaN9ThAwYEN5HZVDqv2f0hj/aXJ6CqPb45IW9Qn4GA==',key_name='tempest-keypair-92686558',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='269fb90362cc4ec1a82ae32822e68947',ramdisk_id='',reservation_id='r-n0m63bqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-243315587',owner_user_name='tempest-TaggedBootDevicesTest-243315587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6137e3924ecd4ab0b8e32ce4b16356b0',uuid=90630ecf-9ed5-47cc-b7b9-b313ed57e46f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converting VIF {"id": "2c7037c4-0933-4be0-a140-616e09b84689", "address": "fa:16:3e:c0:60:20", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c7037c4-09", "ovs_interfaceid": "2c7037c4-0933-4be0-a140-616e09b84689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:60:20,bridge_name='br-int',has_traffic_filtering=True,id=2c7037c4-0933-4be0-a140-616e09b84689,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7037c4-09') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:60:20,bridge_name='br-int',has_traffic_filtering=True,id=2c7037c4-0933-4be0-a140-616e09b84689,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7037c4-09') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c7037c4-09, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=129e54f1-615c-4059-9b13-bc44ec1f9c74) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:03 user nova-compute[75006]: INFO os_vif [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:60:20,bridge_name='br-int',has_traffic_filtering=True,id=2c7037c4-0933-4be0-a140-616e09b84689,network=Network(267489d2-abfb-4d37-8f43-3d4a57432097),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c7037c4-09')
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IrWGzYcq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:28:03 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc4d154-ea1c-45c1-8228-0e1fa015e033]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:28:03 user nova-compute[75006]: No targets found.
Nov 27 03:28:03 user nova-compute[75006]: iSNS:
Nov 27 03:28:03 user nova-compute[75006]: No targets found.
Nov 27 03:28:03 user nova-compute[75006]: STATIC:
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: FIRMWARE:
Nov 27 03:28:03 user nova-compute[75006]: No targets found.
Nov 27 03:28:03 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:28:03 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:28:03 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca4bec7-7006-4a08-97a2-3c92aee7cca5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[829be65f-9d8c-456f-b7b9-08388b2c2f34]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd400549360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6'): ({'sdc'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Removing single pathed devices sdc {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b836c064-4241-4d3b-b44e-b9c185c6bb23]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[343c3acd-d0da-4e94-9600-99ce61ae65e9]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Flushing IO for device /dev/sdc {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed95598c-8ce5-4632-8063-d612eb02ed87]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbfc54a-db82-4969-9924-2ac3fc16daec]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88ea8e9-aa69-4f6e-a1e7-a0af9a31aa3b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0be60-b3b9-43a1-81cd-106e38e2a5bf]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6, portal: 172.16.0.220,3260]
Nov 27 03:28:03 user nova-compute[75006]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6, portal: 172.16.0.220,3260] successful.
Nov 27 03:28:03 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e1724-9a2a-4d86-839f-7fbc4ada97a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be86a2d-3576-4db8-9396-6039f2c54072]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== disconnect_volume: return (352ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSgBZMjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:28:03 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f639e16b-7e99-4473-a01e-922c2066ede3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:28:03 user nova-compute[75006]: No targets found.
Nov 27 03:28:03 user nova-compute[75006]: iSNS:
Nov 27 03:28:03 user nova-compute[75006]: No targets found.
Nov 27 03:28:03 user nova-compute[75006]: STATIC:
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0
Nov 27 03:28:03 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:03 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:03 user nova-compute[75006]: FIRMWARE:
Nov 27 03:28:03 user nova-compute[75006]: No targets found.
Nov 27 03:28:03 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:28:03 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:28:03 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[23143842-5257-41ae-97d5-52bfed1261c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be7f703-c5f2-4738-abc5-9c884291b1cd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:03 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd400549900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67c9a55-725a-470b-81f3-4f485d07db8d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc66b9e-c11a-4caf-be08-cad01a1d389b]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[968925ad-46a9-47a5-9815-d00394bd190f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:28:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc043eb3-b5a2-48a0-98af-ffc304cd1080]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dd4091-8627-468a-a3e6-7a55d8f0218c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7234bc-5060-46ab-b8cd-83bd6e200314]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431, portal: 172.16.0.220,3260]
Nov 27 03:28:04 user nova-compute[75006]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431, portal: 172.16.0.220,3260] successful.
Nov 27 03:28:04 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd20e76b-1827-489f-ade1-365b9f092431 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4602f24-7a66-412d-992c-ff629c692d8c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== disconnect_volume: return (303ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkBYSePr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:28:04 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4848ce33-5610-4bd3-a1fb-f975954ee99e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:28:04 user nova-compute[75006]: No targets found.
Nov 27 03:28:04 user nova-compute[75006]: iSNS:
Nov 27 03:28:04 user nova-compute[75006]: No targets found.
Nov 27 03:28:04 user nova-compute[75006]: STATIC:
Nov 27 03:28:04 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:28:04 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:04 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:04 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb
Nov 27 03:28:04 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:04 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:04 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0
Nov 27 03:28:04 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:28:04 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:28:04 user nova-compute[75006]: FIRMWARE:
Nov 27 03:28:04 user nova-compute[75006]: No targets found.
Nov 27 03:28:04 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:28:04 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:28:04 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba274c46-1fc1-4c75-bd81-c3e10631cc00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d997590b-39f3-4da9-aa13-283246ff677d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:28:04 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:04 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:04 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb (non-flash)
Nov 27 03:28:04 user nova-compute[75006]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:04 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:04 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd400549870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb'): ({'sdf'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Removing single pathed devices sdf {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[83147670-c3b4-494b-90bc-fda86fef556d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cc74c3-f2b5-4e6e-8114-a90cfb9a7aed]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Flushing IO for device /dev/sdf {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[842e7672-eaf8-413a-995c-2d7e58a6d3a4]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd8c4ba-a96b-4061-93dc-64cb73f62c8c]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] SCSI volumes sdf have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893a6ca-99bf-4f71-9a7a-1b22aa26aa42]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:28:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance running successfully.
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] finish_revert_migration finished successfully. {{(pid=75006) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d900e-0f52-458e-87a5-fa55ff1c1857]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-c8b61938-5abf-4313-929e-9215c5a8cd98 req-7fde3455-f0f1-402f-8839-f89088572bc6 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c8b61938-5abf-4313-929e-9215c5a8cd98 req-7fde3455-f0f1-402f-8839-f89088572bc6 service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c8b61938-5abf-4313-929e-9215c5a8cd98 req-7fde3455-f0f1-402f-8839-f89088572bc6 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c8b61938-5abf-4313-929e-9215c5a8cd98 req-7fde3455-f0f1-402f-8839-f89088572bc6 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-c8b61938-5abf-4313-929e-9215c5a8cd98 req-7fde3455-f0f1-402f-8839-f89088572bc6 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:04 user nova-compute[75006]: WARNING nova.compute.manager [req-c8b61938-5abf-4313-929e-9215c5a8cd98 req-7fde3455-f0f1-402f-8839-f89088572bc6 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state resized and task_state resize_reverting.
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb, portal: 172.16.0.220,3260]
Nov 27 03:28:04 user nova-compute[75006]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb, portal: 172.16.0.220,3260] successful.
Nov 27 03:28:04 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42f43345-0e32-430e-b186-d3bfb8d8a5bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8330376-5b04-4e73-bf0d-676156663db5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] <== disconnect_volume: return (341ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:28:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Deleting instance files /opt/stack/data/nova/instances/90630ecf-9ed5-47cc-b7b9-b313ed57e46f_del
Nov 27 03:28:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Deletion of /opt/stack/data/nova/instances/90630ecf-9ed5-47cc-b7b9-b313ed57e46f_del complete
Nov 27 03:28:04 user nova-compute[75006]: INFO nova.compute.manager [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Took 4.13 seconds to destroy the instance on the hypervisor.
Nov 27 03:28:04 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:28:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:04 user nova-compute[75006]: INFO nova.compute.manager [None req-57a57b7a-ec4f-4084-87aa-f3ec9b884a45 tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance to original state: 'active'
Nov 27 03:28:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-b8e97f9e-c707-43dd-9f27-1b41fe055ab0 req-a077535f-b366-45ea-86c7-45de6e7e94b7 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-deleted-2c7037c4-0933-4be0-a140-616e09b84689 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:06 user nova-compute[75006]: INFO nova.compute.manager [req-b8e97f9e-c707-43dd-9f27-1b41fe055ab0 req-a077535f-b366-45ea-86c7-45de6e7e94b7 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Neutron deleted interface 2c7037c4-0933-4be0-a140-616e09b84689; detaching it from the instance and deleting it from the info cache
Nov 27 03:28:06 user nova-compute[75006]: DEBUG nova.network.neutron [req-b8e97f9e-c707-43dd-9f27-1b41fe055ab0 req-a077535f-b366-45ea-86c7-45de6e7e94b7 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [{"id": "d4cdffc5-8802-415c-8293-2371f9193bbf", "address": "fa:16:3e:46:50:c5", "network": {"id": "b58701d4-1e20-4660-a02f-5169914f6dd4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1923703618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4cdffc5-88", "ovs_interfaceid": "d4cdffc5-8802-415c-8293-2371f9193bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "address": "fa:16:3e:cc:e0:31", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7d4323-4c", "ovs_interfaceid": "ee7d4323-4c9b-42d1-b241-9808f3c8b240", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "address": "fa:16:3e:b3:c6:2e", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd140bf5e-3f", "ovs_interfaceid": "d140bf5e-3fda-494d-b8ed-e31c881b312a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "address": "fa:16:3e:8d:75:94", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4992f7c-e7", "ovs_interfaceid": "e4992f7c-e771-4a2d-ab98-d4043b69cd97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "address": "fa:16:3e:45:49:22", "network": {"id": "82cf4062-816d-469c-b10d-b1606bc5a344", "bridge": "br-int", "label": "tempest-device-tagging-net1-995091352", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.184", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a4e019-50", "ovs_interfaceid": "94a4e019-508f-4a0c-aabb-9f71f7e9b8b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "address": "fa:16:3e:4e:c7:75", "network": {"id": "267489d2-abfb-4d37-8f43-3d4a57432097", "bridge": "br-int", "label": "tempest-device-tagging-net2-706776299", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "269fb90362cc4ec1a82ae32822e68947", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb807cd5a-c2", "ovs_interfaceid": "b807cd5a-c23e-4080-b147-fbf84168cfb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-b8e97f9e-c707-43dd-9f27-1b41fe055ab0 req-a077535f-b366-45ea-86c7-45de6e7e94b7 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Detach interface failed, port_id=2c7037c4-0933-4be0-a140-616e09b84689, reason: Instance 90630ecf-9ed5-47cc-b7b9-b313ed57e46f could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:28:07 user nova-compute[75006]: INFO nova.compute.claims [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Claim successful on node user
Nov 27 03:28:07 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:28:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:28:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:28:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:28:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:28:08 user nova-compute[75006]: INFO nova.virt.block_device [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Booting with blank volume at /dev/vda
Nov 27 03:28:08 user nova-compute[75006]: DEBUG nova.policy [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bdc7ee98a95432d96679fc697b7d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bbdcea84574886bbea67eefc84dca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:28:08 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:08 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Took 3.91 seconds to deallocate network for instance.
Nov 27 03:28:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-8a729011-1321-48e7-80e9-9f72cc899b51 req-ae623eb9-63c4-4ea5-bf76-513fd7678b65 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-deleted-e4992f7c-e771-4a2d-ab98-d4043b69cd97 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-8a729011-1321-48e7-80e9-9f72cc899b51 req-ae623eb9-63c4-4ea5-bf76-513fd7678b65 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-deleted-d4cdffc5-8802-415c-8293-2371f9193bbf {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-8a729011-1321-48e7-80e9-9f72cc899b51 req-ae623eb9-63c4-4ea5-bf76-513fd7678b65 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-deleted-94a4e019-508f-4a0c-aabb-9f71f7e9b8b2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-8a729011-1321-48e7-80e9-9f72cc899b51 req-ae623eb9-63c4-4ea5-bf76-513fd7678b65 service nova] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Received event network-vif-deleted-b807cd5a-c23e-4080-b147-fbf84168cfb5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Successfully created port: 4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:28:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Successfully updated port: 4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:28:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquired lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:28:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-c0da8eea-28bc-4c8d-96c5-198b934ce7be req-e1ac92d0-e9ea-486a-b94a-bc81e9b87cb0 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-changed-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-c0da8eea-28bc-4c8d-96c5-198b934ce7be req-e1ac92d0-e9ea-486a-b94a-bc81e9b87cb0 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Refreshing instance network info cache due to event network-changed-4d688103-30d3-4ec5-a22b-25f45607dfa8. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:28:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c0da8eea-28bc-4c8d-96c5-198b934ce7be req-e1ac92d0-e9ea-486a-b94a-bc81e9b87cb0 service nova] Acquiring lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.network.neutron [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updating instance_info_cache with network_info: [{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Releasing lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance network_info: |[{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c0da8eea-28bc-4c8d-96c5-198b934ce7be req-e1ac92d0-e9ea-486a-b94a-bc81e9b87cb0 service nova] Acquired lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.network.neutron [req-c0da8eea-28bc-4c8d-96c5-198b934ce7be req-e1ac92d0-e9ea-486a-b94a-bc81e9b87cb0 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Refreshing network info cache for port 4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:28:11 user nova-compute[75006]: INFO nova.compute.claims [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Claim successful on node user
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.network.neutron [req-c0da8eea-28bc-4c8d-96c5-198b934ce7be req-e1ac92d0-e9ea-486a-b94a-bc81e9b87cb0 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updated VIF entry in instance network info cache for port 4d688103-30d3-4ec5-a22b-25f45607dfa8. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.network.neutron [req-c0da8eea-28bc-4c8d-96c5-198b934ce7be req-e1ac92d0-e9ea-486a-b94a-bc81e9b87cb0 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updating instance_info_cache with network_info: [{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c0da8eea-28bc-4c8d-96c5-198b934ce7be req-e1ac92d0-e9ea-486a-b94a-bc81e9b87cb0 service nova] Releasing lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:28:11 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:28:11 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.policy [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b50c3d4e86ae40fbb9f38f2a88066a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ada4ca9c11a4996ad5f00f6beac2398', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:28:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Creating image(s)
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "/opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "/opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:12 user nova-compute[75006]: INFO nova.compute.manager [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] [instance: 90630ecf-9ed5-47cc-b7b9-b313ed57e46f] Took 4.06 seconds to detach 3 volumes for instance.
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk 1073741824" returned: 0 in 0.065s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Successfully created port: 2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Cannot resize image /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Ensure instance console log exists: /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:13 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Deleted allocations for instance 90630ecf-9ed5-47cc-b7b9-b313ed57e46f
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-788a9e1c-2d8b-4912-9a26-2ce14b3067d6 tempest-TaggedBootDevicesTest-243315587 tempest-TaggedBootDevicesTest-243315587-project-member] Lock "90630ecf-9ed5-47cc-b7b9-b313ed57e46f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.819s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Successfully updated port: 2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquired lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-67f0a545-0d7d-446b-978c-19c81f202a52 req-91f3822f-a858-4804-b363-13df88dbfed8 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received event network-changed-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-67f0a545-0d7d-446b-978c-19c81f202a52 req-91f3822f-a858-4804-b363-13df88dbfed8 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Refreshing instance network info cache due to event network-changed-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-67f0a545-0d7d-446b-978c-19c81f202a52 req-91f3822f-a858-4804-b363-13df88dbfed8 service nova] Acquiring lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Updating instance_info_cache with network_info: [{"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Releasing lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Instance network_info: |[{"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-67f0a545-0d7d-446b-978c-19c81f202a52 req-91f3822f-a858-4804-b363-13df88dbfed8 service nova] Acquired lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-67f0a545-0d7d-446b-978c-19c81f202a52 req-91f3822f-a858-4804-b363-13df88dbfed8 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Refreshing network info cache for port 2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Start _get_guest_xml network_info=[{"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:28:13 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:13 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1374435848',display_name='tempest-VolumesSnapshotTestJSON-instance-1374435848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1374435848',id=29,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzo2j0woqrK7rdIUy+kI5sNZcCY+DoXCTv0LI7jrEbJ/uI8sAExI5c5M13Du3LN19LftEr5F99pEECmHK0hUnMLsiwm460SJfw7CDXMaWU2jmsprTkwh0szNCXGY/BOYA==',key_name='tempest-keypair-1428051761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ada4ca9c11a4996ad5f00f6beac2398',ramdisk_id='',reservation_id='r-in2y43fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-59016333',owner_user_name='tempest-VolumesSnapshotTestJSON-59016333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b50c3d4e86ae40fbb9f38f2a88066a03',uuid=ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converting VIF {"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:77:55,bridge_name='br-int',has_traffic_filtering=True,id=2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae897ca-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'pci_devices' on Instance uuid ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:28:13 user nova-compute[75006]:   <uuid>ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa</uuid>
Nov 27 03:28:13 user nova-compute[75006]:   <name>instance-0000001d</name>
Nov 27 03:28:13 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:28:13 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:28:13 user nova-compute[75006]:   <metadata>
Nov 27 03:28:13 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:28:13 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:28:13 user nova-compute[75006]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1374435848</nova:name>
Nov 27 03:28:13 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:28:13</nova:creationTime>
Nov 27 03:28:13 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:28:13 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:28:13 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:28:13 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:28:13 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:28:13 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:28:13 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:28:13 user nova-compute[75006]:       <nova:owner>
Nov 27 03:28:13 user nova-compute[75006]:         <nova:user uuid="b50c3d4e86ae40fbb9f38f2a88066a03">tempest-VolumesSnapshotTestJSON-59016333-project-member</nova:user>
Nov 27 03:28:13 user nova-compute[75006]:         <nova:project uuid="6ada4ca9c11a4996ad5f00f6beac2398">tempest-VolumesSnapshotTestJSON-59016333</nova:project>
Nov 27 03:28:13 user nova-compute[75006]:       </nova:owner>
Nov 27 03:28:13 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:28:13 user nova-compute[75006]:       <nova:ports>
Nov 27 03:28:13 user nova-compute[75006]:         <nova:port uuid="2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713">
Nov 27 03:28:13 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:28:13 user nova-compute[75006]:         </nova:port>
Nov 27 03:28:13 user nova-compute[75006]:       </nova:ports>
Nov 27 03:28:13 user nova-compute[75006]:     </nova:instance>
Nov 27 03:28:13 user nova-compute[75006]:   </metadata>
Nov 27 03:28:13 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:28:13 user nova-compute[75006]:     <system>
Nov 27 03:28:13 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:28:13 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:28:13 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:28:13 user nova-compute[75006]:       <entry name="serial">ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa</entry>
Nov 27 03:28:13 user nova-compute[75006]:       <entry name="uuid">ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa</entry>
Nov 27 03:28:13 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:28:13 user nova-compute[75006]:     </system>
Nov 27 03:28:13 user nova-compute[75006]:   </sysinfo>
Nov 27 03:28:13 user nova-compute[75006]:   <os>
Nov 27 03:28:13 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:28:13 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:28:13 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:28:13 user nova-compute[75006]:   </os>
Nov 27 03:28:13 user nova-compute[75006]:   <features>
Nov 27 03:28:13 user nova-compute[75006]:     <acpi/>
Nov 27 03:28:13 user nova-compute[75006]:     <apic/>
Nov 27 03:28:13 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:28:13 user nova-compute[75006]:   </features>
Nov 27 03:28:13 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:28:13 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:28:13 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:28:13 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:28:13 user nova-compute[75006]:   </clock>
Nov 27 03:28:13 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:28:13 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:28:13 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:28:13 user nova-compute[75006]:   </cpu>
Nov 27 03:28:13 user nova-compute[75006]:   <devices>
Nov 27 03:28:13 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:28:13 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:28:13 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk"/>
Nov 27 03:28:13 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:28:13 user nova-compute[75006]:     </disk>
Nov 27 03:28:13 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:28:13 user nova-compute[75006]:       <mac address="fa:16:3e:7f:77:55"/>
Nov 27 03:28:13 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:13 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:28:13 user nova-compute[75006]:       <target dev="tap2ae897ca-6c"/>
Nov 27 03:28:13 user nova-compute[75006]:     </interface>
Nov 27 03:28:13 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:28:13 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/console.log" append="off"/>
Nov 27 03:28:13 user nova-compute[75006]:     </serial>
Nov 27 03:28:13 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:28:13 user nova-compute[75006]:     <video>
Nov 27 03:28:13 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:13 user nova-compute[75006]:     </video>
Nov 27 03:28:13 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:28:13 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:28:13 user nova-compute[75006]:     </rng>
Nov 27 03:28:13 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:28:13 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:28:13 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:28:13 user nova-compute[75006]:     </memballoon>
Nov 27 03:28:13 user nova-compute[75006]:   </devices>
Nov 27 03:28:13 user nova-compute[75006]: </domain>
Nov 27 03:28:13 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1374435848',display_name='tempest-VolumesSnapshotTestJSON-instance-1374435848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1374435848',id=29,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzo2j0woqrK7rdIUy+kI5sNZcCY+DoXCTv0LI7jrEbJ/uI8sAExI5c5M13Du3LN19LftEr5F99pEECmHK0hUnMLsiwm460SJfw7CDXMaWU2jmsprTkwh0szNCXGY/BOYA==',key_name='tempest-keypair-1428051761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ada4ca9c11a4996ad5f00f6beac2398',ramdisk_id='',reservation_id='r-in2y43fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-59016333',owner_user_name='tempest-VolumesSnapshotTestJSON-59016333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b50c3d4e86ae40fbb9f38f2a88066a03',uuid=ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converting VIF {"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:77:55,bridge_name='br-int',has_traffic_filtering=True,id=2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae897ca-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG os_vif [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:77:55,bridge_name='br-int',has_traffic_filtering=True,id=2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae897ca-6c') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e851e2cb-a489-54ba-82e6-bb13e72179da', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ae897ca-6c, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ae897ca-6c, col_values=(('qos', UUID('102f3e50-e8d8-418b-9b3d-f51b0a6726b2')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ae897ca-6c, col_values=(('external_ids', {'iface-id': '2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:77:55', 'vm-uuid': 'ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:13 user nova-compute[75006]: INFO os_vif [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:77:55,bridge_name='br-int',has_traffic_filtering=True,id=2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae897ca-6c')
Nov 27 03:28:13 user nova-compute[75006]: DEBUG os_brick.utils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56055b2-9597-4763-8b37-e3aa53e282b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5eeee0-992b-4f84-821c-af052fdd1dab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No VIF found with MAC fa:16:3e:7f:77:55, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:28:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0cbd7b-fc28-43e4-b967-f2766e4ccecb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd37b668-e924-4187-b007-1806493e1b4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:28:14 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:28:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2c8942-aabc-4920-97a1-0491e0825e18]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG os_brick.utils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updating existing volume attachment record: 2491488d-e7f7-477b-9fa6-cb007e8458ff {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG nova.network.neutron [req-67f0a545-0d7d-446b-978c-19c81f202a52 req-91f3822f-a858-4804-b363-13df88dbfed8 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Updated VIF entry in instance network info cache for port 2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG nova.network.neutron [req-67f0a545-0d7d-446b-978c-19c81f202a52 req-91f3822f-a858-4804-b363-13df88dbfed8 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Updating instance_info_cache with network_info: [{"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-67f0a545-0d7d-446b-978c-19c81f202a52 req-91f3822f-a858-4804-b363-13df88dbfed8 service nova] Releasing lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-7582778a-785d-41f4-8305-5e85148cb2fc req-c281d34d-8d77-415a-a802-deb5ead72549 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received event network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7582778a-785d-41f4-8305-5e85148cb2fc req-c281d34d-8d77-415a-a802-deb5ead72549 service nova] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7582778a-785d-41f4-8305-5e85148cb2fc req-c281d34d-8d77-415a-a802-deb5ead72549 service nova] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7582778a-785d-41f4-8305-5e85148cb2fc req-c281d34d-8d77-415a-a802-deb5ead72549 service nova] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-7582778a-785d-41f4-8305-5e85148cb2fc req-c281d34d-8d77-415a-a802-deb5ead72549 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] No waiting events found dispatching network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:15 user nova-compute[75006]: WARNING nova.compute.manager [req-7582778a-785d-41f4-8305-5e85148cb2fc req-c281d34d-8d77-415a-a802-deb5ead72549 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received unexpected event network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 for instance with vm_state building and task_state spawning.
Nov 27 03:28:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:28:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Instance spawned successfully.
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:17 user nova-compute[75006]: INFO nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:28:17 user nova-compute[75006]: INFO nova.compute.manager [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Took 6.33 seconds to build instance.
Nov 27 03:28:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8be06846-035f-4897-b82c-72031760538e tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.535s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-77274c90-8d84-4dcd-a72a-a0a8d1d7c697 req-b18f2331-a067-4441-a022-c2feb2349203 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received event network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-77274c90-8d84-4dcd-a72a-a0a8d1d7c697 req-b18f2331-a067-4441-a022-c2feb2349203 service nova] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-77274c90-8d84-4dcd-a72a-a0a8d1d7c697 req-b18f2331-a067-4441-a022-c2feb2349203 service nova] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-77274c90-8d84-4dcd-a72a-a0a8d1d7c697 req-b18f2331-a067-4441-a022-c2feb2349203 service nova] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-77274c90-8d84-4dcd-a72a-a0a8d1d7c697 req-b18f2331-a067-4441-a022-c2feb2349203 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] No waiting events found dispatching network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:17 user nova-compute[75006]: WARNING nova.compute.manager [req-77274c90-8d84-4dcd-a72a-a0a8d1d7c697 req-b18f2331-a067-4441-a022-c2feb2349203 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received unexpected event network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 for instance with vm_state active and task_state None.
Nov 27 03:28:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:28:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Creating image(s)
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Ensure instance console log exists: /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Start _get_guest_xml network_info=[{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '2491488d-e7f7-477b-9fa6-cb007e8458ff', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcNGHyAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '55bfa775-09a3-40d5-a361-8c88466bfeb2', 'attached_at': '', 'detached_at': '', 'volume_id': '257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'serial': '257d1601-7eb5-4be0-8c2c-561dd6c7935b'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:28:21 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:21 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcNGHyAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:28:21 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:28:21 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:28:21 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa415d4f-5897-4d91-a0f4-61581b23337f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:28:21 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b57cf1-2601-4bec-895c-b590fd53eff4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b] added
Nov 27 03:28:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e76af32-ab56-4c8a-9b3a-a0452ffc5f26]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb90c96-aaee-4d31-b281-61fc15bd631c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcNGHyAe {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcNGHyAe" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab39c89d-3ea1-4ca3-95cb-a679f5159453]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RcNGHyAe'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ebda5d-6f35-422c-853c-a80256170882]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[100a1458-6e32-423e-9632-c1b6b1e1eb0c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:21 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:21 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[570c0254-4703-4a09-9620-4fc6c54e94dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b, portal: 172.16.0.220,3260]
Nov 27 03:28:21 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b, portal: 172.16.0.220,3260] successful.
Nov 27 03:28:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.067s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aeb4b24-cbee-417a-a435-bfb72cda8a5d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54b5ece-4566-46be-a066-23e165e5c022]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:21 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:21 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:28:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:28:21 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:28:21 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:28:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b97bf37-65ea-474f-9391-28ae58ea250e]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:28:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcNGHyAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26137303963636336', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137303963636336', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2086826292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2086826292',id=28,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-eis90tv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:08Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=55bfa775-09a3-40d5-a361-8c88466bfeb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:aa:0f,bridge_name='br-int',has_traffic_filtering=True,id=4d688103-30d3-4ec5-a22b-25f45607dfa8,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d688103-30') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.objects.instance [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'pci_devices' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:28:22 user nova-compute[75006]:   <uuid>55bfa775-09a3-40d5-a361-8c88466bfeb2</uuid>
Nov 27 03:28:22 user nova-compute[75006]:   <name>instance-0000001c</name>
Nov 27 03:28:22 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:28:22 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:28:22 user nova-compute[75006]:   <metadata>
Nov 27 03:28:22 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:28:22 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:28:22 user nova-compute[75006]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2086826292</nova:name>
Nov 27 03:28:22 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:28:21</nova:creationTime>
Nov 27 03:28:22 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:28:22 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:28:22 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:28:22 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:28:22 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:28:22 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:28:22 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:28:22 user nova-compute[75006]:       <nova:owner>
Nov 27 03:28:22 user nova-compute[75006]:         <nova:user uuid="7bdc7ee98a95432d96679fc697b7d61d">tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member</nova:user>
Nov 27 03:28:22 user nova-compute[75006]:         <nova:project uuid="03bbdcea84574886bbea67eefc84dca0">tempest-ServerBootFromVolumeStableRescueTest-2135085811</nova:project>
Nov 27 03:28:22 user nova-compute[75006]:       </nova:owner>
Nov 27 03:28:22 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:28:22 user nova-compute[75006]:       <nova:ports>
Nov 27 03:28:22 user nova-compute[75006]:         <nova:port uuid="4d688103-30d3-4ec5-a22b-25f45607dfa8">
Nov 27 03:28:22 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 03:28:22 user nova-compute[75006]:         </nova:port>
Nov 27 03:28:22 user nova-compute[75006]:       </nova:ports>
Nov 27 03:28:22 user nova-compute[75006]:     </nova:instance>
Nov 27 03:28:22 user nova-compute[75006]:   </metadata>
Nov 27 03:28:22 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:28:22 user nova-compute[75006]:     <system>
Nov 27 03:28:22 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:28:22 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:28:22 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:28:22 user nova-compute[75006]:       <entry name="serial">55bfa775-09a3-40d5-a361-8c88466bfeb2</entry>
Nov 27 03:28:22 user nova-compute[75006]:       <entry name="uuid">55bfa775-09a3-40d5-a361-8c88466bfeb2</entry>
Nov 27 03:28:22 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:28:22 user nova-compute[75006]:     </system>
Nov 27 03:28:22 user nova-compute[75006]:   </sysinfo>
Nov 27 03:28:22 user nova-compute[75006]:   <os>
Nov 27 03:28:22 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:28:22 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:28:22 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:28:22 user nova-compute[75006]:   </os>
Nov 27 03:28:22 user nova-compute[75006]:   <features>
Nov 27 03:28:22 user nova-compute[75006]:     <acpi/>
Nov 27 03:28:22 user nova-compute[75006]:     <apic/>
Nov 27 03:28:22 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:28:22 user nova-compute[75006]:   </features>
Nov 27 03:28:22 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:28:22 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:28:22 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:28:22 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:28:22 user nova-compute[75006]:   </clock>
Nov 27 03:28:22 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:28:22 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:28:22 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:28:22 user nova-compute[75006]:   </cpu>
Nov 27 03:28:22 user nova-compute[75006]:   <devices>
Nov 27 03:28:22 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:28:22 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:28:22 user nova-compute[75006]:       <source dev="/dev/sdc"/>
Nov 27 03:28:22 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:28:22 user nova-compute[75006]:       <serial>257d1601-7eb5-4be0-8c2c-561dd6c7935b</serial>
Nov 27 03:28:22 user nova-compute[75006]:     </disk>
Nov 27 03:28:22 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:28:22 user nova-compute[75006]:       <mac address="fa:16:3e:54:aa:0f"/>
Nov 27 03:28:22 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:22 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:28:22 user nova-compute[75006]:       <target dev="tap4d688103-30"/>
Nov 27 03:28:22 user nova-compute[75006]:     </interface>
Nov 27 03:28:22 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:28:22 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/console.log" append="off"/>
Nov 27 03:28:22 user nova-compute[75006]:     </serial>
Nov 27 03:28:22 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:28:22 user nova-compute[75006]:     <video>
Nov 27 03:28:22 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:22 user nova-compute[75006]:     </video>
Nov 27 03:28:22 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:28:22 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:28:22 user nova-compute[75006]:     </rng>
Nov 27 03:28:22 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:28:22 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:28:22 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:28:22 user nova-compute[75006]:     </memballoon>
Nov 27 03:28:22 user nova-compute[75006]:   </devices>
Nov 27 03:28:22 user nova-compute[75006]: </domain>
Nov 27 03:28:22 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2086826292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2086826292',id=28,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-eis90tv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:08Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=55bfa775-09a3-40d5-a361-8c88466bfeb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:aa:0f,bridge_name='br-int',has_traffic_filtering=True,id=4d688103-30d3-4ec5-a22b-25f45607dfa8,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d688103-30') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG os_vif [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:aa:0f,bridge_name='br-int',has_traffic_filtering=True,id=4d688103-30d3-4ec5-a22b-25f45607dfa8,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d688103-30') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '334af45c-090a-533e-b3f2-3efb088bd3a1', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d688103-30, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d688103-30, col_values=(('qos', UUID('ed2ca614-920e-474a-ad78-de1ddbb970a1')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d688103-30, col_values=(('external_ids', {'iface-id': '4d688103-30d3-4ec5-a22b-25f45607dfa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:aa:0f', 'vm-uuid': '55bfa775-09a3-40d5-a361-8c88466bfeb2'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:22 user nova-compute[75006]: INFO os_vif [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:aa:0f,bridge_name='br-int',has_traffic_filtering=True,id=4d688103-30d3-4ec5-a22b-25f45607dfa8,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d688103-30')
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:28:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No VIF found with MAC fa:16:3e:54:aa:0f, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:28:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-edf42fa4-9878-4191-b06f-7c2f12b541bc req-1b693b61-b7ac-4337-9bb4-2e3455558f95 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-edf42fa4-9878-4191-b06f-7c2f12b541bc req-1b693b61-b7ac-4337-9bb4-2e3455558f95 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-edf42fa4-9878-4191-b06f-7c2f12b541bc req-1b693b61-b7ac-4337-9bb4-2e3455558f95 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-edf42fa4-9878-4191-b06f-7c2f12b541bc req-1b693b61-b7ac-4337-9bb4-2e3455558f95 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-edf42fa4-9878-4191-b06f-7c2f12b541bc req-1b693b61-b7ac-4337-9bb4-2e3455558f95 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:24 user nova-compute[75006]: WARNING nova.compute.manager [req-edf42fa4-9878-4191-b06f-7c2f12b541bc req-1b693b61-b7ac-4337-9bb4-2e3455558f95 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state building and task_state spawning.
Nov 27 03:28:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:28:26 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance spawned successfully.
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-ade04d16-5ea1-4017-b5da-a2ef27d427a5 req-8864d4b7-c7e5-4279-a049-f5b6337b0733 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ade04d16-5ea1-4017-b5da-a2ef27d427a5 req-8864d4b7-c7e5-4279-a049-f5b6337b0733 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ade04d16-5ea1-4017-b5da-a2ef27d427a5 req-8864d4b7-c7e5-4279-a049-f5b6337b0733 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ade04d16-5ea1-4017-b5da-a2ef27d427a5 req-8864d4b7-c7e5-4279-a049-f5b6337b0733 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-ade04d16-5ea1-4017-b5da-a2ef27d427a5 req-8864d4b7-c7e5-4279-a049-f5b6337b0733 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:26 user nova-compute[75006]: WARNING nova.compute.manager [req-ade04d16-5ea1-4017-b5da-a2ef27d427a5 req-8864d4b7-c7e5-4279-a049-f5b6337b0733 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state building and task_state spawning.
Nov 27 03:28:26 user nova-compute[75006]: INFO nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:28:26 user nova-compute[75006]: INFO nova.compute.manager [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Took 19.20 seconds to build instance.
Nov 27 03:28:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-053ebc82-3803-4637-94bb-9522e8b48ae4 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.309s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:28:27 user nova-compute[75006]: INFO nova.compute.claims [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Claim successful on node user
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.network.neutron [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:28:27 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:28:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.policy [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1836d0da810f4525addd0b02ae57c617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30af4989ad4414083de0576cf4dbd48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:28:27 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Creating image(s)
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "/opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "/opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "/opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk 1073741824" returned: 0 in 0.049s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG nova.network.neutron [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Successfully created port: 87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Cannot resize image /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Ensure instance console log exists: /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.neutron [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Successfully updated port: 87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquired lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.neutron [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-ae793cb0-7983-4c5a-9265-e70511f9f5da req-32661c8b-a531-4195-aef0-61771711389b service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received event network-changed-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-ae793cb0-7983-4c5a-9265-e70511f9f5da req-32661c8b-a531-4195-aef0-61771711389b service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Refreshing instance network info cache due to event network-changed-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ae793cb0-7983-4c5a-9265-e70511f9f5da req-32661c8b-a531-4195-aef0-61771711389b service nova] Acquiring lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.neutron [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.neutron [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Updating instance_info_cache with network_info: [{"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Releasing lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Instance network_info: |[{"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ae793cb0-7983-4c5a-9265-e70511f9f5da req-32661c8b-a531-4195-aef0-61771711389b service nova] Acquired lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.neutron [req-ae793cb0-7983-4c5a-9265-e70511f9f5da req-32661c8b-a531-4195-aef0-61771711389b service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Refreshing network info cache for port 87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Start _get_guest_xml network_info=[{"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:28:29 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:29 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-542504561',display_name='tempest-AttachVolumeNegativeTest-server-542504561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-542504561',id=30,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIc6T4sYGevzofw/2EW0ULAn1CY3IrPocfu+vQJnsTLSnNhQM9Ndd5R5miYPRWMxunOowVhYQ2+MECiN0sdqRzbXF89T2h5gXpVPoapuKEjngJTxQMuixYsazC1U5ApTw==',key_name='tempest-keypair-1183071301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-zu176z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=20805ff8-bf32-4d64-8380-472195a9119a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bb:d8,bridge_name='br-int',has_traffic_filtering=True,id=87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d2ca5e-f4') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.objects.instance [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'pci_devices' on Instance uuid 20805ff8-bf32-4d64-8380-472195a9119a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:28:29 user nova-compute[75006]:   <uuid>20805ff8-bf32-4d64-8380-472195a9119a</uuid>
Nov 27 03:28:29 user nova-compute[75006]:   <name>instance-0000001e</name>
Nov 27 03:28:29 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:28:29 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:28:29 user nova-compute[75006]:   <metadata>
Nov 27 03:28:29 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:28:29 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:28:29 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeNegativeTest-server-542504561</nova:name>
Nov 27 03:28:29 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:28:29</nova:creationTime>
Nov 27 03:28:29 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:28:29 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:28:29 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:28:29 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:28:29 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:28:29 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:28:29 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:28:29 user nova-compute[75006]:       <nova:owner>
Nov 27 03:28:29 user nova-compute[75006]:         <nova:user uuid="1836d0da810f4525addd0b02ae57c617">tempest-AttachVolumeNegativeTest-66969864-project-member</nova:user>
Nov 27 03:28:29 user nova-compute[75006]:         <nova:project uuid="f30af4989ad4414083de0576cf4dbd48">tempest-AttachVolumeNegativeTest-66969864</nova:project>
Nov 27 03:28:29 user nova-compute[75006]:       </nova:owner>
Nov 27 03:28:29 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:28:29 user nova-compute[75006]:       <nova:ports>
Nov 27 03:28:29 user nova-compute[75006]:         <nova:port uuid="87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff">
Nov 27 03:28:29 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:28:29 user nova-compute[75006]:         </nova:port>
Nov 27 03:28:29 user nova-compute[75006]:       </nova:ports>
Nov 27 03:28:29 user nova-compute[75006]:     </nova:instance>
Nov 27 03:28:29 user nova-compute[75006]:   </metadata>
Nov 27 03:28:29 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:28:29 user nova-compute[75006]:     <system>
Nov 27 03:28:29 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:28:29 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:28:29 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:28:29 user nova-compute[75006]:       <entry name="serial">20805ff8-bf32-4d64-8380-472195a9119a</entry>
Nov 27 03:28:29 user nova-compute[75006]:       <entry name="uuid">20805ff8-bf32-4d64-8380-472195a9119a</entry>
Nov 27 03:28:29 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:28:29 user nova-compute[75006]:     </system>
Nov 27 03:28:29 user nova-compute[75006]:   </sysinfo>
Nov 27 03:28:29 user nova-compute[75006]:   <os>
Nov 27 03:28:29 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:28:29 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:28:29 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:28:29 user nova-compute[75006]:   </os>
Nov 27 03:28:29 user nova-compute[75006]:   <features>
Nov 27 03:28:29 user nova-compute[75006]:     <acpi/>
Nov 27 03:28:29 user nova-compute[75006]:     <apic/>
Nov 27 03:28:29 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:28:29 user nova-compute[75006]:   </features>
Nov 27 03:28:29 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:28:29 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:28:29 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:28:29 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:28:29 user nova-compute[75006]:   </clock>
Nov 27 03:28:29 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:28:29 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:28:29 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:28:29 user nova-compute[75006]:   </cpu>
Nov 27 03:28:29 user nova-compute[75006]:   <devices>
Nov 27 03:28:29 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:28:29 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:28:29 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk"/>
Nov 27 03:28:29 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:28:29 user nova-compute[75006]:     </disk>
Nov 27 03:28:29 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:28:29 user nova-compute[75006]:       <mac address="fa:16:3e:d1:bb:d8"/>
Nov 27 03:28:29 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:29 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:28:29 user nova-compute[75006]:       <target dev="tap87d2ca5e-f4"/>
Nov 27 03:28:29 user nova-compute[75006]:     </interface>
Nov 27 03:28:29 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:28:29 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/console.log" append="off"/>
Nov 27 03:28:29 user nova-compute[75006]:     </serial>
Nov 27 03:28:29 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:28:29 user nova-compute[75006]:     <video>
Nov 27 03:28:29 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:29 user nova-compute[75006]:     </video>
Nov 27 03:28:29 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:28:29 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:28:29 user nova-compute[75006]:     </rng>
Nov 27 03:28:29 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:28:29 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:28:29 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:28:29 user nova-compute[75006]:     </memballoon>
Nov 27 03:28:29 user nova-compute[75006]:   </devices>
Nov 27 03:28:29 user nova-compute[75006]: </domain>
Nov 27 03:28:29 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-542504561',display_name='tempest-AttachVolumeNegativeTest-server-542504561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-542504561',id=30,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIc6T4sYGevzofw/2EW0ULAn1CY3IrPocfu+vQJnsTLSnNhQM9Ndd5R5miYPRWMxunOowVhYQ2+MECiN0sdqRzbXF89T2h5gXpVPoapuKEjngJTxQMuixYsazC1U5ApTw==',key_name='tempest-keypair-1183071301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-zu176z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=20805ff8-bf32-4d64-8380-472195a9119a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bb:d8,bridge_name='br-int',has_traffic_filtering=True,id=87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d2ca5e-f4') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG os_vif [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bb:d8,bridge_name='br-int',has_traffic_filtering=True,id=87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d2ca5e-f4') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2647355-dec5-56ea-beba-4326b6a26154', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87d2ca5e-f4, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87d2ca5e-f4, col_values=(('qos', UUID('d1affd52-820b-46e0-b907-f940962978d6')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87d2ca5e-f4, col_values=(('external_ids', {'iface-id': '87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:bb:d8', 'vm-uuid': '20805ff8-bf32-4d64-8380-472195a9119a'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:29 user nova-compute[75006]: INFO os_vif [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:bb:d8,bridge_name='br-int',has_traffic_filtering=True,id=87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d2ca5e-f4')
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No VIF found with MAC fa:16:3e:d1:bb:d8, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.neutron [req-ae793cb0-7983-4c5a-9265-e70511f9f5da req-32661c8b-a531-4195-aef0-61771711389b service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Updated VIF entry in instance network info cache for port 87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG nova.network.neutron [req-ae793cb0-7983-4c5a-9265-e70511f9f5da req-32661c8b-a531-4195-aef0-61771711389b service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Updating instance_info_cache with network_info: [{"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ae793cb0-7983-4c5a-9265-e70511f9f5da req-32661c8b-a531-4195-aef0-61771711389b service nova] Releasing lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-940881a7-f3cb-44ed-b0ea-f85798ff1781 req-52516307-34d9-40d7-b6cd-1c0afb3d2d23 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received event network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-940881a7-f3cb-44ed-b0ea-f85798ff1781 req-52516307-34d9-40d7-b6cd-1c0afb3d2d23 service nova] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-940881a7-f3cb-44ed-b0ea-f85798ff1781 req-52516307-34d9-40d7-b6cd-1c0afb3d2d23 service nova] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-940881a7-f3cb-44ed-b0ea-f85798ff1781 req-52516307-34d9-40d7-b6cd-1c0afb3d2d23 service nova] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-940881a7-f3cb-44ed-b0ea-f85798ff1781 req-52516307-34d9-40d7-b6cd-1c0afb3d2d23 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] No waiting events found dispatching network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:31 user nova-compute[75006]: WARNING nova.compute.manager [req-940881a7-f3cb-44ed-b0ea-f85798ff1781 req-52516307-34d9-40d7-b6cd-1c0afb3d2d23 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received unexpected event network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff for instance with vm_state building and task_state spawning.
Nov 27 03:28:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:28:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Instance spawned successfully.
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-aa9cb6f3-fa8d-4e6b-be5f-bf137b22ed39 req-b3f3b3a1-4405-4d4a-affe-8ece7ed24abe service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received event network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa9cb6f3-fa8d-4e6b-be5f-bf137b22ed39 req-b3f3b3a1-4405-4d4a-affe-8ece7ed24abe service nova] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa9cb6f3-fa8d-4e6b-be5f-bf137b22ed39 req-b3f3b3a1-4405-4d4a-affe-8ece7ed24abe service nova] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa9cb6f3-fa8d-4e6b-be5f-bf137b22ed39 req-b3f3b3a1-4405-4d4a-affe-8ece7ed24abe service nova] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-aa9cb6f3-fa8d-4e6b-be5f-bf137b22ed39 req-b3f3b3a1-4405-4d4a-affe-8ece7ed24abe service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] No waiting events found dispatching network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:33 user nova-compute[75006]: WARNING nova.compute.manager [req-aa9cb6f3-fa8d-4e6b-be5f-bf137b22ed39 req-b3f3b3a1-4405-4d4a-affe-8ece7ed24abe service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received unexpected event network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff for instance with vm_state building and task_state spawning.
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:33 user nova-compute[75006]: INFO nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 27 03:28:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:28:33 user nova-compute[75006]: INFO nova.compute.manager [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Took 6.57 seconds to build instance.
Nov 27 03:28:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-959ad014-69bc-40b8-9904-98dc5caaaaf4 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.667s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:28:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:28:43 user nova-compute[75006]: INFO nova.compute.claims [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Claim successful on node user
Nov 27 03:28:43 user nova-compute[75006]: INFO nova.compute.manager [None req-6ec3f2a3-dd00-4b55-aa53-ed28d01d9231 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Unrescuing
Nov 27 03:28:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6ec3f2a3-dd00-4b55-aa53-ed28d01d9231 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6ec3f2a3-dd00-4b55-aa53-ed28d01d9231 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquired lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6ec3f2a3-dd00-4b55-aa53-ed28d01d9231 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:28:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.policy [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1275432e762e409d92b00e7c3303de53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c41971e35b24517acd8b84a22e14b97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6ec3f2a3-dd00-4b55-aa53-ed28d01d9231 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updating instance_info_cache with network_info: [{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6ec3f2a3-dd00-4b55-aa53-ed28d01d9231 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Releasing lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6ec3f2a3-dd00-4b55-aa53-ed28d01d9231 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'flavor' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:28:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Creating image(s)
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "/opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "/opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk 1073741824" returned: 0 in 0.075s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-c42523a8-4195-4396-9047-e028deb13f09 req-da8b828c-9fe3-4df0-8605-bfecbc13c9be service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c42523a8-4195-4396-9047-e028deb13f09 req-da8b828c-9fe3-4df0-8605-bfecbc13c9be service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c42523a8-4195-4396-9047-e028deb13f09 req-da8b828c-9fe3-4df0-8605-bfecbc13c9be service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c42523a8-4195-4396-9047-e028deb13f09 req-da8b828c-9fe3-4df0-8605-bfecbc13c9be service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-c42523a8-4195-4396-9047-e028deb13f09 req-da8b828c-9fe3-4df0-8605-bfecbc13c9be service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:45 user nova-compute[75006]: WARNING nova.compute.manager [req-c42523a8-4195-4396-9047-e028deb13f09 req-da8b828c-9fe3-4df0-8605-bfecbc13c9be service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.network.neutron [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Successfully created port: 88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.195s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance destroyed successfully.
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Cannot resize image /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Ensure instance console log exists: /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.network.neutron [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Successfully updated port: 88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquired lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.network.neutron [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-066e74e8-d0d1-40a7-8a6a-27902c43ebdb req-61ad9b4b-d34f-41d8-ba8d-791cf4bb5683 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received event network-changed-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-066e74e8-d0d1-40a7-8a6a-27902c43ebdb req-61ad9b4b-d34f-41d8-ba8d-791cf4bb5683 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Refreshing instance network info cache due to event network-changed-88559c16-3699-43f5-968a-bf65e5cf194b. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-066e74e8-d0d1-40a7-8a6a-27902c43ebdb req-61ad9b4b-d34f-41d8-ba8d-791cf4bb5683 service nova] Acquiring lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:45 user nova-compute[75006]: DEBUG nova.network.neutron [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.network.neutron [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Updating instance_info_cache with network_info: [{"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Releasing lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Instance network_info: |[{"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-066e74e8-d0d1-40a7-8a6a-27902c43ebdb req-61ad9b4b-d34f-41d8-ba8d-791cf4bb5683 service nova] Acquired lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.network.neutron [req-066e74e8-d0d1-40a7-8a6a-27902c43ebdb req-61ad9b4b-d34f-41d8-ba8d-791cf4bb5683 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Refreshing network info cache for port 88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Start _get_guest_xml network_info=[{"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:28:46 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:46 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2038909523',display_name='tempest-AttachVolumeTestJSON-server-2038909523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2038909523',id=31,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5C7zzqoYEzCYgGI4UpVN+wTWSC8LEIeC3fPNjus+CEguL9swu7I/f0PTAIw723R/eUhxPCwKckDy13gFPHh3XnnVHV9biwNEa4exrz7xHiASHRXZ4u7L0tzf+m4vqHQ==',key_name='tempest-keypair-1543023471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-zqwfv7lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=8bad1d7e-9d3c-4c63-b47a-634b4874d791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8b:a2,bridge_name='br-int',has_traffic_filtering=True,id=88559c16-3699-43f5-968a-bf65e5cf194b,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88559c16-36') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.objects.instance [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:28:46 user nova-compute[75006]:   <uuid>8bad1d7e-9d3c-4c63-b47a-634b4874d791</uuid>
Nov 27 03:28:46 user nova-compute[75006]:   <name>instance-0000001f</name>
Nov 27 03:28:46 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:28:46 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:28:46 user nova-compute[75006]:   <metadata>
Nov 27 03:28:46 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:28:46 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:28:46 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeTestJSON-server-2038909523</nova:name>
Nov 27 03:28:46 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:28:46</nova:creationTime>
Nov 27 03:28:46 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:28:46 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:28:46 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:28:46 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:28:46 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:28:46 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:28:46 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:28:46 user nova-compute[75006]:       <nova:owner>
Nov 27 03:28:46 user nova-compute[75006]:         <nova:user uuid="1275432e762e409d92b00e7c3303de53">tempest-AttachVolumeTestJSON-245260319-project-member</nova:user>
Nov 27 03:28:46 user nova-compute[75006]:         <nova:project uuid="9c41971e35b24517acd8b84a22e14b97">tempest-AttachVolumeTestJSON-245260319</nova:project>
Nov 27 03:28:46 user nova-compute[75006]:       </nova:owner>
Nov 27 03:28:46 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:28:46 user nova-compute[75006]:       <nova:ports>
Nov 27 03:28:46 user nova-compute[75006]:         <nova:port uuid="88559c16-3699-43f5-968a-bf65e5cf194b">
Nov 27 03:28:46 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 03:28:46 user nova-compute[75006]:         </nova:port>
Nov 27 03:28:46 user nova-compute[75006]:       </nova:ports>
Nov 27 03:28:46 user nova-compute[75006]:     </nova:instance>
Nov 27 03:28:46 user nova-compute[75006]:   </metadata>
Nov 27 03:28:46 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:28:46 user nova-compute[75006]:     <system>
Nov 27 03:28:46 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:28:46 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:28:46 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:28:46 user nova-compute[75006]:       <entry name="serial">8bad1d7e-9d3c-4c63-b47a-634b4874d791</entry>
Nov 27 03:28:46 user nova-compute[75006]:       <entry name="uuid">8bad1d7e-9d3c-4c63-b47a-634b4874d791</entry>
Nov 27 03:28:46 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:28:46 user nova-compute[75006]:     </system>
Nov 27 03:28:46 user nova-compute[75006]:   </sysinfo>
Nov 27 03:28:46 user nova-compute[75006]:   <os>
Nov 27 03:28:46 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:28:46 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:28:46 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:28:46 user nova-compute[75006]:   </os>
Nov 27 03:28:46 user nova-compute[75006]:   <features>
Nov 27 03:28:46 user nova-compute[75006]:     <acpi/>
Nov 27 03:28:46 user nova-compute[75006]:     <apic/>
Nov 27 03:28:46 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:28:46 user nova-compute[75006]:   </features>
Nov 27 03:28:46 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:28:46 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:28:46 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:28:46 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:28:46 user nova-compute[75006]:   </clock>
Nov 27 03:28:46 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:28:46 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:28:46 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:28:46 user nova-compute[75006]:   </cpu>
Nov 27 03:28:46 user nova-compute[75006]:   <devices>
Nov 27 03:28:46 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:28:46 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:28:46 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk"/>
Nov 27 03:28:46 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:28:46 user nova-compute[75006]:     </disk>
Nov 27 03:28:46 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:28:46 user nova-compute[75006]:       <mac address="fa:16:3e:89:8b:a2"/>
Nov 27 03:28:46 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:46 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:28:46 user nova-compute[75006]:       <target dev="tap88559c16-36"/>
Nov 27 03:28:46 user nova-compute[75006]:     </interface>
Nov 27 03:28:46 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:28:46 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/console.log" append="off"/>
Nov 27 03:28:46 user nova-compute[75006]:     </serial>
Nov 27 03:28:46 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:28:46 user nova-compute[75006]:     <video>
Nov 27 03:28:46 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:28:46 user nova-compute[75006]:     </video>
Nov 27 03:28:46 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:28:46 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:28:46 user nova-compute[75006]:     </rng>
Nov 27 03:28:46 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:28:46 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:28:46 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:28:46 user nova-compute[75006]:     </memballoon>
Nov 27 03:28:46 user nova-compute[75006]:   </devices>
Nov 27 03:28:46 user nova-compute[75006]: </domain>
Nov 27 03:28:46 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2038909523',display_name='tempest-AttachVolumeTestJSON-server-2038909523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2038909523',id=31,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5C7zzqoYEzCYgGI4UpVN+wTWSC8LEIeC3fPNjus+CEguL9swu7I/f0PTAIw723R/eUhxPCwKckDy13gFPHh3XnnVHV9biwNEa4exrz7xHiASHRXZ4u7L0tzf+m4vqHQ==',key_name='tempest-keypair-1543023471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-zqwfv7lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=8bad1d7e-9d3c-4c63-b47a-634b4874d791,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:8b:a2,bridge_name='br-int',has_traffic_filtering=True,id=88559c16-3699-43f5-968a-bf65e5cf194b,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88559c16-36') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG os_vif [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8b:a2,bridge_name='br-int',has_traffic_filtering=True,id=88559c16-3699-43f5-968a-bf65e5cf194b,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88559c16-36') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '125dbc68-0678-547e-a026-667ee2139b45', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88559c16-36, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88559c16-36, col_values=(('qos', UUID('3ee260ea-c0a7-49a4-ab5e-2ee80bcb1929')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88559c16-36, col_values=(('external_ids', {'iface-id': '88559c16-3699-43f5-968a-bf65e5cf194b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:8b:a2', 'vm-uuid': '8bad1d7e-9d3c-4c63-b47a-634b4874d791'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:46 user nova-compute[75006]: INFO os_vif [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:8b:a2,bridge_name='br-int',has_traffic_filtering=True,id=88559c16-3699-43f5-968a-bf65e5cf194b,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88559c16-36')
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No VIF found with MAC fa:16:3e:89:8b:a2, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.network.neutron [req-066e74e8-d0d1-40a7-8a6a-27902c43ebdb req-61ad9b4b-d34f-41d8-ba8d-791cf4bb5683 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Updated VIF entry in instance network info cache for port 88559c16-3699-43f5-968a-bf65e5cf194b. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG nova.network.neutron [req-066e74e8-d0d1-40a7-8a6a-27902c43ebdb req-61ad9b4b-d34f-41d8-ba8d-791cf4bb5683 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Updating instance_info_cache with network_info: [{"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-066e74e8-d0d1-40a7-8a6a-27902c43ebdb req-61ad9b4b-d34f-41d8-ba8d-791cf4bb5683 service nova] Releasing lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:47 user nova-compute[75006]: WARNING nova.compute.manager [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:28:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:47 user nova-compute[75006]: WARNING nova.compute.manager [req-7c95dfb4-e17f-4cb5-a74d-88a38c437957 req-daab2070-8f24-4e2b-b497-55a4487ca98a service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:28:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-230665df-41a3-45e7-84c4-a26d17cd6c5b req-0e815d51-9463-4897-9f81-9aee4cdfc2e0 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received event network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-230665df-41a3-45e7-84c4-a26d17cd6c5b req-0e815d51-9463-4897-9f81-9aee4cdfc2e0 service nova] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-230665df-41a3-45e7-84c4-a26d17cd6c5b req-0e815d51-9463-4897-9f81-9aee4cdfc2e0 service nova] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-230665df-41a3-45e7-84c4-a26d17cd6c5b req-0e815d51-9463-4897-9f81-9aee4cdfc2e0 service nova] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-230665df-41a3-45e7-84c4-a26d17cd6c5b req-0e815d51-9463-4897-9f81-9aee4cdfc2e0 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] No waiting events found dispatching network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:48 user nova-compute[75006]: WARNING nova.compute.manager [req-230665df-41a3-45e7-84c4-a26d17cd6c5b req-0e815d51-9463-4897-9f81-9aee4cdfc2e0 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received unexpected event network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b for instance with vm_state building and task_state spawning.
Nov 27 03:28:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-3a76e9dd-2501-4eac-b53c-9237fcb08eab req-b108f740-4d1a-471a-9921-1ec489b444b0 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3a76e9dd-2501-4eac-b53c-9237fcb08eab req-b108f740-4d1a-471a-9921-1ec489b444b0 service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3a76e9dd-2501-4eac-b53c-9237fcb08eab req-b108f740-4d1a-471a-9921-1ec489b444b0 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3a76e9dd-2501-4eac-b53c-9237fcb08eab req-b108f740-4d1a-471a-9921-1ec489b444b0 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-3a76e9dd-2501-4eac-b53c-9237fcb08eab req-b108f740-4d1a-471a-9921-1ec489b444b0 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:49 user nova-compute[75006]: WARNING nova.compute.manager [req-3a76e9dd-2501-4eac-b53c-9237fcb08eab req-b108f740-4d1a-471a-9921-1ec489b444b0 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:28:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6ec3f2a3-dd00-4b55-aa53-ed28d01d9231 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:28:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Instance spawned successfully.
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:28:50 user nova-compute[75006]: INFO nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 27 03:28:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:28:50 user nova-compute[75006]: INFO nova.compute.manager [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Took 6.95 seconds to build instance.
Nov 27 03:28:50 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-eb28df3e-a4ac-426f-ab73-a423c8ecd3fe tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.050s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-d62c9a8e-fc08-4ba0-9048-01c7e388908c req-50dc87ff-d574-4670-b114-8ff4d2c32b80 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received event network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d62c9a8e-fc08-4ba0-9048-01c7e388908c req-50dc87ff-d574-4670-b114-8ff4d2c32b80 service nova] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d62c9a8e-fc08-4ba0-9048-01c7e388908c req-50dc87ff-d574-4670-b114-8ff4d2c32b80 service nova] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d62c9a8e-fc08-4ba0-9048-01c7e388908c req-50dc87ff-d574-4670-b114-8ff4d2c32b80 service nova] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-d62c9a8e-fc08-4ba0-9048-01c7e388908c req-50dc87ff-d574-4670-b114-8ff4d2c32b80 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] No waiting events found dispatching network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:28:51 user nova-compute[75006]: WARNING nova.compute.manager [req-d62c9a8e-fc08-4ba0-9048-01c7e388908c req-50dc87ff-d574-4670-b114-8ff4d2c32b80 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received unexpected event network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b for instance with vm_state active and task_state None.
Nov 27 03:28:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:51 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:28:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:28:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:56 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:56 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7556MB free_disk=25.40229034423828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 1556b696-96e5-4cd6-9246-3673235d47fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 20805ff8-bf32-4d64-8380-472195a9119a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:28:56 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.801s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:28:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:28:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updating instance_info_cache with network_info: [{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:28:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:28:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:28:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:28:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:28:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:00 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:00 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:29:00 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:29:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:29:11 user nova-compute[75006]: INFO nova.compute.claims [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Claim successful on node user
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:29:11 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.policy [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8a9fbc3a61f4c60ab5d911ebe3e5053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb74bd34122d4fde87e2ec3dee947b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:29:11 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Creating image(s)
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "/opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "/opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "/opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk 1073741824" returned: 0 in 0.049s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Successfully created port: c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Cannot resize image /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Ensure instance console log exists: /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Successfully updated port: c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquired lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-94cfc2c0-a537-489e-ac22-590dce2fb849 req-cae867f4-2e28-461e-86b4-63a24a5bdcb6 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-changed-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-94cfc2c0-a537-489e-ac22-590dce2fb849 req-cae867f4-2e28-461e-86b4-63a24a5bdcb6 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Refreshing instance network info cache due to event network-changed-c1ecf59a-5a42-4cfb-be41-dc5182153ce5. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-94cfc2c0-a537-489e-ac22-590dce2fb849 req-cae867f4-2e28-461e-86b4-63a24a5bdcb6 service nova] Acquiring lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updating instance_info_cache with network_info: [{"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Releasing lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Instance network_info: |[{"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-94cfc2c0-a537-489e-ac22-590dce2fb849 req-cae867f4-2e28-461e-86b4-63a24a5bdcb6 service nova] Acquired lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-94cfc2c0-a537-489e-ac22-590dce2fb849 req-cae867f4-2e28-461e-86b4-63a24a5bdcb6 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Refreshing network info cache for port c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Start _get_guest_xml network_info=[{"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:29:13 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:29:13 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1609677707',display_name='tempest-TestStampPattern-server-1609677707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1609677707',id=32,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCvEMUIZDar/9uKmjM+iVQHTuryauOaSvt4utJ6Dze5XI9Qu+OWQuvie19iCR6iK3Kap2FXhDlTmZNuKNo1KhaH5r71CU3Tiaop1CqRcF45PpszmuxGaWkGiSqEIk0MhA==',key_name='tempest-TestStampPattern-920267456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb74bd34122d4fde87e2ec3dee947b9d',ramdisk_id='',reservation_id='r-dyjbzzxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-250178234',owner_user_name='tempest-TestStampPattern-250178234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:29:12Z,user_data=None,user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',uuid=6990b476-cfd5-43c0-a295-5ee42393d35b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converting VIF {"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:99:fd,bridge_name='br-int',has_traffic_filtering=True,id=c1ecf59a-5a42-4cfb-be41-dc5182153ce5,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ecf59a-5a') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.objects.instance [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'pci_devices' on Instance uuid 6990b476-cfd5-43c0-a295-5ee42393d35b {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:29:13 user nova-compute[75006]:   <uuid>6990b476-cfd5-43c0-a295-5ee42393d35b</uuid>
Nov 27 03:29:13 user nova-compute[75006]:   <name>instance-00000020</name>
Nov 27 03:29:13 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:29:13 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:29:13 user nova-compute[75006]:   <metadata>
Nov 27 03:29:13 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:29:13 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:29:13 user nova-compute[75006]:       <nova:name>tempest-TestStampPattern-server-1609677707</nova:name>
Nov 27 03:29:13 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:29:13</nova:creationTime>
Nov 27 03:29:13 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:29:13 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:29:13 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:29:13 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:29:13 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:29:13 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:29:13 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:29:13 user nova-compute[75006]:       <nova:owner>
Nov 27 03:29:13 user nova-compute[75006]:         <nova:user uuid="e8a9fbc3a61f4c60ab5d911ebe3e5053">tempest-TestStampPattern-250178234-project-member</nova:user>
Nov 27 03:29:13 user nova-compute[75006]:         <nova:project uuid="bb74bd34122d4fde87e2ec3dee947b9d">tempest-TestStampPattern-250178234</nova:project>
Nov 27 03:29:13 user nova-compute[75006]:       </nova:owner>
Nov 27 03:29:13 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:29:13 user nova-compute[75006]:       <nova:ports>
Nov 27 03:29:13 user nova-compute[75006]:         <nova:port uuid="c1ecf59a-5a42-4cfb-be41-dc5182153ce5">
Nov 27 03:29:13 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 03:29:13 user nova-compute[75006]:         </nova:port>
Nov 27 03:29:13 user nova-compute[75006]:       </nova:ports>
Nov 27 03:29:13 user nova-compute[75006]:     </nova:instance>
Nov 27 03:29:13 user nova-compute[75006]:   </metadata>
Nov 27 03:29:13 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:29:13 user nova-compute[75006]:     <system>
Nov 27 03:29:13 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:29:13 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:29:13 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:29:13 user nova-compute[75006]:       <entry name="serial">6990b476-cfd5-43c0-a295-5ee42393d35b</entry>
Nov 27 03:29:13 user nova-compute[75006]:       <entry name="uuid">6990b476-cfd5-43c0-a295-5ee42393d35b</entry>
Nov 27 03:29:13 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:29:13 user nova-compute[75006]:     </system>
Nov 27 03:29:13 user nova-compute[75006]:   </sysinfo>
Nov 27 03:29:13 user nova-compute[75006]:   <os>
Nov 27 03:29:13 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:29:13 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:29:13 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:29:13 user nova-compute[75006]:   </os>
Nov 27 03:29:13 user nova-compute[75006]:   <features>
Nov 27 03:29:13 user nova-compute[75006]:     <acpi/>
Nov 27 03:29:13 user nova-compute[75006]:     <apic/>
Nov 27 03:29:13 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:29:13 user nova-compute[75006]:   </features>
Nov 27 03:29:13 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:29:13 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:29:13 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:29:13 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:29:13 user nova-compute[75006]:   </clock>
Nov 27 03:29:13 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:29:13 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:29:13 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:29:13 user nova-compute[75006]:   </cpu>
Nov 27 03:29:13 user nova-compute[75006]:   <devices>
Nov 27 03:29:13 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:29:13 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:29:13 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk"/>
Nov 27 03:29:13 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:29:13 user nova-compute[75006]:     </disk>
Nov 27 03:29:13 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:29:13 user nova-compute[75006]:       <mac address="fa:16:3e:3c:99:fd"/>
Nov 27 03:29:13 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:29:13 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:29:13 user nova-compute[75006]:       <target dev="tapc1ecf59a-5a"/>
Nov 27 03:29:13 user nova-compute[75006]:     </interface>
Nov 27 03:29:13 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:29:13 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/console.log" append="off"/>
Nov 27 03:29:13 user nova-compute[75006]:     </serial>
Nov 27 03:29:13 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:29:13 user nova-compute[75006]:     <video>
Nov 27 03:29:13 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:29:13 user nova-compute[75006]:     </video>
Nov 27 03:29:13 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:29:13 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:29:13 user nova-compute[75006]:     </rng>
Nov 27 03:29:13 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:29:13 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:29:13 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:29:13 user nova-compute[75006]:     </memballoon>
Nov 27 03:29:13 user nova-compute[75006]:   </devices>
Nov 27 03:29:13 user nova-compute[75006]: </domain>
Nov 27 03:29:13 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1609677707',display_name='tempest-TestStampPattern-server-1609677707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1609677707',id=32,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCvEMUIZDar/9uKmjM+iVQHTuryauOaSvt4utJ6Dze5XI9Qu+OWQuvie19iCR6iK3Kap2FXhDlTmZNuKNo1KhaH5r71CU3Tiaop1CqRcF45PpszmuxGaWkGiSqEIk0MhA==',key_name='tempest-TestStampPattern-920267456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb74bd34122d4fde87e2ec3dee947b9d',ramdisk_id='',reservation_id='r-dyjbzzxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-250178234',owner_user_name='tempest-TestStampPattern-250178234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:29:12Z,user_data=None,user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',uuid=6990b476-cfd5-43c0-a295-5ee42393d35b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converting VIF {"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:99:fd,bridge_name='br-int',has_traffic_filtering=True,id=c1ecf59a-5a42-4cfb-be41-dc5182153ce5,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ecf59a-5a') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG os_vif [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:99:fd,bridge_name='br-int',has_traffic_filtering=True,id=c1ecf59a-5a42-4cfb-be41-dc5182153ce5,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ecf59a-5a') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbd6bc49-2858-5077-9cf8-33f111d1ae2d', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1ecf59a-5a, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1ecf59a-5a, col_values=(('qos', UUID('c297db72-78cd-4c6a-8938-1c6e4d1e474a')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1ecf59a-5a, col_values=(('external_ids', {'iface-id': 'c1ecf59a-5a42-4cfb-be41-dc5182153ce5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:99:fd', 'vm-uuid': '6990b476-cfd5-43c0-a295-5ee42393d35b'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:13 user nova-compute[75006]: INFO os_vif [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:99:fd,bridge_name='br-int',has_traffic_filtering=True,id=c1ecf59a-5a42-4cfb-be41-dc5182153ce5,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ecf59a-5a')
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No VIF found with MAC fa:16:3e:3c:99:fd, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-94cfc2c0-a537-489e-ac22-590dce2fb849 req-cae867f4-2e28-461e-86b4-63a24a5bdcb6 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updated VIF entry in instance network info cache for port c1ecf59a-5a42-4cfb-be41-dc5182153ce5. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-94cfc2c0-a537-489e-ac22-590dce2fb849 req-cae867f4-2e28-461e-86b4-63a24a5bdcb6 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updating instance_info_cache with network_info: [{"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-94cfc2c0-a537-489e-ac22-590dce2fb849 req-cae867f4-2e28-461e-86b4-63a24a5bdcb6 service nova] Releasing lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-836e32b9-7863-477a-b443-399cc06bda53 req-76655be6-de0e-4566-8afc-58943780bdc3 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-836e32b9-7863-477a-b443-399cc06bda53 req-76655be6-de0e-4566-8afc-58943780bdc3 service nova] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-836e32b9-7863-477a-b443-399cc06bda53 req-76655be6-de0e-4566-8afc-58943780bdc3 service nova] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-836e32b9-7863-477a-b443-399cc06bda53 req-76655be6-de0e-4566-8afc-58943780bdc3 service nova] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-836e32b9-7863-477a-b443-399cc06bda53 req-76655be6-de0e-4566-8afc-58943780bdc3 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] No waiting events found dispatching network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:15 user nova-compute[75006]: WARNING nova.compute.manager [req-836e32b9-7863-477a-b443-399cc06bda53 req-76655be6-de0e-4566-8afc-58943780bdc3 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received unexpected event network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 for instance with vm_state building and task_state spawning.
Nov 27 03:29:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:29:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Instance spawned successfully.
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-55b76d04-25f7-4459-92f4-45e7c6c7303c req-9a311621-1d47-4e7b-9dc9-a85c3178cba4 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-55b76d04-25f7-4459-92f4-45e7c6c7303c req-9a311621-1d47-4e7b-9dc9-a85c3178cba4 service nova] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-55b76d04-25f7-4459-92f4-45e7c6c7303c req-9a311621-1d47-4e7b-9dc9-a85c3178cba4 service nova] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-55b76d04-25f7-4459-92f4-45e7c6c7303c req-9a311621-1d47-4e7b-9dc9-a85c3178cba4 service nova] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-55b76d04-25f7-4459-92f4-45e7c6c7303c req-9a311621-1d47-4e7b-9dc9-a85c3178cba4 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] No waiting events found dispatching network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:17 user nova-compute[75006]: WARNING nova.compute.manager [req-55b76d04-25f7-4459-92f4-45e7c6c7303c req-9a311621-1d47-4e7b-9dc9-a85c3178cba4 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received unexpected event network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 for instance with vm_state building and task_state spawning.
Nov 27 03:29:17 user nova-compute[75006]: INFO nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 27 03:29:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:29:17 user nova-compute[75006]: INFO nova.compute.manager [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Took 6.24 seconds to build instance.
Nov 27 03:29:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ba3aa176-87db-4a7c-a606-db4e71bd6c9f tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.341s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "87c685b0-44b9-400b-b98a-2066988857f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:29:21 user nova-compute[75006]: INFO nova.compute.claims [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Claim successful on node user
Nov 27 03:29:21 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:29:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:29:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG nova.policy [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4a327fa49cc468f8cbf23ae2d6d30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa566d4c0fd4cbdbaf2b67ac2cea59a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:29:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Creating image(s)
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "/opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "/opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "/opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.216s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk 1073741824" returned: 0 in 0.052s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Successfully created port: 424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:29:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Cannot resize image /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Ensure instance console log exists: /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Successfully updated port: 424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquired lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-1444f8e0-ea8c-4cc7-bac1-5da528da5046 req-37fb05de-59c1-497d-bdcc-9bec520e36f6 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-changed-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-1444f8e0-ea8c-4cc7-bac1-5da528da5046 req-37fb05de-59c1-497d-bdcc-9bec520e36f6 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Refreshing instance network info cache due to event network-changed-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1444f8e0-ea8c-4cc7-bac1-5da528da5046 req-37fb05de-59c1-497d-bdcc-9bec520e36f6 service nova] Acquiring lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:29:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updating instance_info_cache with network_info: [{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Releasing lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Instance network_info: |[{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1444f8e0-ea8c-4cc7-bac1-5da528da5046 req-37fb05de-59c1-497d-bdcc-9bec520e36f6 service nova] Acquired lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.network.neutron [req-1444f8e0-ea8c-4cc7-bac1-5da528da5046 req-37fb05de-59c1-497d-bdcc-9bec520e36f6 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Refreshing network info cache for port 424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Start _get_guest_xml network_info=[{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:29:24 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:29:24 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:29:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-900982225',display_name='tempest-ServerActionsTestOtherA-server-900982225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-900982225',id=33,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-85mf4sor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:29:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=87c685b0-44b9-400b-b98a-2066988857f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:45:06,bridge_name='br-int',has_traffic_filtering=True,id=424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424e4fc6-5f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'pci_devices' on Instance uuid 87c685b0-44b9-400b-b98a-2066988857f4 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:29:24 user nova-compute[75006]:   <uuid>87c685b0-44b9-400b-b98a-2066988857f4</uuid>
Nov 27 03:29:24 user nova-compute[75006]:   <name>instance-00000021</name>
Nov 27 03:29:24 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:29:24 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:29:24 user nova-compute[75006]:   <metadata>
Nov 27 03:29:24 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:29:24 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:29:24 user nova-compute[75006]:       <nova:name>tempest-ServerActionsTestOtherA-server-900982225</nova:name>
Nov 27 03:29:24 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:29:24</nova:creationTime>
Nov 27 03:29:24 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:29:24 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:29:24 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:29:24 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:29:24 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:29:24 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:29:24 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:29:24 user nova-compute[75006]:       <nova:owner>
Nov 27 03:29:24 user nova-compute[75006]:         <nova:user uuid="d4a327fa49cc468f8cbf23ae2d6d30d1">tempest-ServerActionsTestOtherA-507729530-project-member</nova:user>
Nov 27 03:29:24 user nova-compute[75006]:         <nova:project uuid="daa566d4c0fd4cbdbaf2b67ac2cea59a">tempest-ServerActionsTestOtherA-507729530</nova:project>
Nov 27 03:29:24 user nova-compute[75006]:       </nova:owner>
Nov 27 03:29:24 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:29:24 user nova-compute[75006]:       <nova:ports>
Nov 27 03:29:24 user nova-compute[75006]:         <nova:port uuid="424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828">
Nov 27 03:29:24 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 03:29:24 user nova-compute[75006]:         </nova:port>
Nov 27 03:29:24 user nova-compute[75006]:       </nova:ports>
Nov 27 03:29:24 user nova-compute[75006]:     </nova:instance>
Nov 27 03:29:24 user nova-compute[75006]:   </metadata>
Nov 27 03:29:24 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:29:24 user nova-compute[75006]:     <system>
Nov 27 03:29:24 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:29:24 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:29:24 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:29:24 user nova-compute[75006]:       <entry name="serial">87c685b0-44b9-400b-b98a-2066988857f4</entry>
Nov 27 03:29:24 user nova-compute[75006]:       <entry name="uuid">87c685b0-44b9-400b-b98a-2066988857f4</entry>
Nov 27 03:29:24 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:29:24 user nova-compute[75006]:     </system>
Nov 27 03:29:24 user nova-compute[75006]:   </sysinfo>
Nov 27 03:29:24 user nova-compute[75006]:   <os>
Nov 27 03:29:24 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:29:24 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:29:24 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:29:24 user nova-compute[75006]:   </os>
Nov 27 03:29:24 user nova-compute[75006]:   <features>
Nov 27 03:29:24 user nova-compute[75006]:     <acpi/>
Nov 27 03:29:24 user nova-compute[75006]:     <apic/>
Nov 27 03:29:24 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:29:24 user nova-compute[75006]:   </features>
Nov 27 03:29:24 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:29:24 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:29:24 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:29:24 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:29:24 user nova-compute[75006]:   </clock>
Nov 27 03:29:24 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:29:24 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:29:24 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:29:24 user nova-compute[75006]:   </cpu>
Nov 27 03:29:24 user nova-compute[75006]:   <devices>
Nov 27 03:29:24 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:29:24 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:29:24 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk"/>
Nov 27 03:29:24 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:29:24 user nova-compute[75006]:     </disk>
Nov 27 03:29:24 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:29:24 user nova-compute[75006]:       <mac address="fa:16:3e:ea:45:06"/>
Nov 27 03:29:24 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:29:24 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:29:24 user nova-compute[75006]:       <target dev="tap424e4fc6-5f"/>
Nov 27 03:29:24 user nova-compute[75006]:     </interface>
Nov 27 03:29:24 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:29:24 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/console.log" append="off"/>
Nov 27 03:29:24 user nova-compute[75006]:     </serial>
Nov 27 03:29:24 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:29:24 user nova-compute[75006]:     <video>
Nov 27 03:29:24 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:29:24 user nova-compute[75006]:     </video>
Nov 27 03:29:24 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:29:24 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:29:24 user nova-compute[75006]:     </rng>
Nov 27 03:29:24 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:29:24 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:29:24 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:29:24 user nova-compute[75006]:     </memballoon>
Nov 27 03:29:24 user nova-compute[75006]:   </devices>
Nov 27 03:29:24 user nova-compute[75006]: </domain>
Nov 27 03:29:24 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:29:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-900982225',display_name='tempest-ServerActionsTestOtherA-server-900982225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-900982225',id=33,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-85mf4sor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:29:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=87c685b0-44b9-400b-b98a-2066988857f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:45:06,bridge_name='br-int',has_traffic_filtering=True,id=424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424e4fc6-5f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG os_vif [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:45:06,bridge_name='br-int',has_traffic_filtering=True,id=424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424e4fc6-5f') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4a0553c-ba58-513d-bb9f-6f4f4a490a7d', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap424e4fc6-5f, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap424e4fc6-5f, col_values=(('qos', UUID('53492a85-65b6-4275-bccf-99e099a3278d')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap424e4fc6-5f, col_values=(('external_ids', {'iface-id': '424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:45:06', 'vm-uuid': '87c685b0-44b9-400b-b98a-2066988857f4'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:24 user nova-compute[75006]: INFO os_vif [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:45:06,bridge_name='br-int',has_traffic_filtering=True,id=424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424e4fc6-5f')
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No VIF found with MAC fa:16:3e:ea:45:06, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.network.neutron [req-1444f8e0-ea8c-4cc7-bac1-5da528da5046 req-37fb05de-59c1-497d-bdcc-9bec520e36f6 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updated VIF entry in instance network info cache for port 424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG nova.network.neutron [req-1444f8e0-ea8c-4cc7-bac1-5da528da5046 req-37fb05de-59c1-497d-bdcc-9bec520e36f6 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updating instance_info_cache with network_info: [{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1444f8e0-ea8c-4cc7-bac1-5da528da5046 req-37fb05de-59c1-497d-bdcc-9bec520e36f6 service nova] Releasing lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-4daf5805-0a03-4977-83b8-0c3ecadc75a5 req-732082b9-5cd3-44fd-8057-ef2482e77582 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4daf5805-0a03-4977-83b8-0c3ecadc75a5 req-732082b9-5cd3-44fd-8057-ef2482e77582 service nova] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4daf5805-0a03-4977-83b8-0c3ecadc75a5 req-732082b9-5cd3-44fd-8057-ef2482e77582 service nova] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4daf5805-0a03-4977-83b8-0c3ecadc75a5 req-732082b9-5cd3-44fd-8057-ef2482e77582 service nova] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-4daf5805-0a03-4977-83b8-0c3ecadc75a5 req-732082b9-5cd3-44fd-8057-ef2482e77582 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] No waiting events found dispatching network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:26 user nova-compute[75006]: WARNING nova.compute.manager [req-4daf5805-0a03-4977-83b8-0c3ecadc75a5 req-732082b9-5cd3-44fd-8057-ef2482e77582 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received unexpected event network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 for instance with vm_state building and task_state spawning.
Nov 27 03:29:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.compute.manager [req-313a8805-a971-419a-9b20-cf25e6eb254a req-a55f1534-51e8-4c3d-bf2f-31ce29296530 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-313a8805-a971-419a-9b20-cf25e6eb254a req-a55f1534-51e8-4c3d-bf2f-31ce29296530 service nova] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-313a8805-a971-419a-9b20-cf25e6eb254a req-a55f1534-51e8-4c3d-bf2f-31ce29296530 service nova] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-313a8805-a971-419a-9b20-cf25e6eb254a req-a55f1534-51e8-4c3d-bf2f-31ce29296530 service nova] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.compute.manager [req-313a8805-a971-419a-9b20-cf25e6eb254a req-a55f1534-51e8-4c3d-bf2f-31ce29296530 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] No waiting events found dispatching network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:28 user nova-compute[75006]: WARNING nova.compute.manager [req-313a8805-a971-419a-9b20-cf25e6eb254a req-a55f1534-51e8-4c3d-bf2f-31ce29296530 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received unexpected event network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 for instance with vm_state building and task_state spawning.
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:29:28 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Instance spawned successfully.
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:29:28 user nova-compute[75006]: INFO nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:29:28 user nova-compute[75006]: INFO nova.compute.manager [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Took 6.90 seconds to build instance.
Nov 27 03:29:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0ff56696-1d60-45ee-89d3-31e2279bd7f7 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "87c685b0-44b9-400b-b98a-2066988857f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.014s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.compute.manager [req-550f42da-3118-44a5-81cc-f8e0283af43d req-d9427b0f-02cd-4cba-81e8-e8cda0286930 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.compute.manager [req-550f42da-3118-44a5-81cc-f8e0283af43d req-d9427b0f-02cd-4cba-81e8-e8cda0286930 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing instance network info cache due to event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-550f42da-3118-44a5-81cc-f8e0283af43d req-d9427b0f-02cd-4cba-81e8-e8cda0286930 service nova] Acquiring lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-550f42da-3118-44a5-81cc-f8e0283af43d req-d9427b0f-02cd-4cba-81e8-e8cda0286930 service nova] Acquired lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:28 user nova-compute[75006]: DEBUG nova.network.neutron [req-550f42da-3118-44a5-81cc-f8e0283af43d req-d9427b0f-02cd-4cba-81e8-e8cda0286930 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG nova.network.neutron [req-550f42da-3118-44a5-81cc-f8e0283af43d req-d9427b0f-02cd-4cba-81e8-e8cda0286930 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updated VIF entry in instance network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG nova.network.neutron [req-550f42da-3118-44a5-81cc-f8e0283af43d req-d9427b0f-02cd-4cba-81e8-e8cda0286930 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-550f42da-3118-44a5-81cc-f8e0283af43d req-d9427b0f-02cd-4cba-81e8-e8cda0286930 service nova] Releasing lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:29 user nova-compute[75006]: INFO nova.compute.manager [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Shelve offloading
Nov 27 03:29:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance destroyed successfully.
Nov 27 03:29:30 user nova-compute[75006]: DEBUG nova.compute.manager [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquired lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG nova.network.neutron [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-unplugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] No waiting events found dispatching network-vif-unplugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:30 user nova-compute[75006]: WARNING nova.compute.manager [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received unexpected event network-vif-unplugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 for instance with vm_state active and task_state shelving.
Nov 27 03:29:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] No waiting events found dispatching network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:30 user nova-compute[75006]: WARNING nova.compute.manager [req-d1f4490f-0254-4703-b803-1fa5179711d6 req-ff2a1b26-2b35-443c-b306-95aa29be5218 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received unexpected event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 for instance with vm_state active and task_state shelving.
Nov 27 03:29:30 user nova-compute[75006]: DEBUG nova.network.neutron [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Releasing lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance destroyed successfully.
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.objects.instance [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lazy-loading 'resources' on Instance uuid 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1350526478',display_name='tempest-TestShelveInstance-server-1350526478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1350526478',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlQSNuDrUjejO0Gh0EnVAdJHDpXJSubJx7mrtBILqMgeIwPMdBqlx3c/VqejDgOvDMNN3L0QqSQDY4OZx8knM+Umllig6NVhbmKGxLaxDgBM3MYpnCYIWlWsHwT/gfSZA==',key_name='tempest-TestShelveInstance-800573928',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4cdd7f6a9244a1d825cda5b92610432',ramdisk_id='',reservation_id='r-oh2aae0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-313467041',owner_user_name='tempest-TestShelveInstance-313467041-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:27:50Z,user_data=None,user_id='24fcf1d84af04fa09278a318510fe6fd',uuid=67512cf7-e06d-406e-ad8b-fcfd6fbbb472,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converting VIF {"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_vif [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5137b18-6b, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-ff67a9cc-e5c8-4ff4-9c8d-f583e2ba85b8 req-11873dd2-467f-451a-af11-a0f06f8e8b55 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-ff67a9cc-e5c8-4ff4-9c8d-f583e2ba85b8 req-11873dd2-467f-451a-af11-a0f06f8e8b55 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing instance network info cache due to event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ff67a9cc-e5c8-4ff4-9c8d-f583e2ba85b8 req-11873dd2-467f-451a-af11-a0f06f8e8b55 service nova] Acquiring lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ff67a9cc-e5c8-4ff4-9c8d-f583e2ba85b8 req-11873dd2-467f-451a-af11-a0f06f8e8b55 service nova] Acquired lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-ff67a9cc-e5c8-4ff4-9c8d-f583e2ba85b8 req-11873dd2-467f-451a-af11-a0f06f8e8b55 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34d8ed10-e218-4287-b00b-6778564f92e0) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:31 user nova-compute[75006]: INFO os_vif [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b')
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJijpCdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:29:31 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[84edbe17-13a4-447f-8d0b-2fb091ffb61a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:29:31 user nova-compute[75006]: No targets found.
Nov 27 03:29:31 user nova-compute[75006]: iSNS:
Nov 27 03:29:31 user nova-compute[75006]: No targets found.
Nov 27 03:29:31 user nova-compute[75006]: STATIC:
Nov 27 03:29:31 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:29:31 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:29:31 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:29:31 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:29:31 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:29:31 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:29:31 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0
Nov 27 03:29:31 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:29:31 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:29:31 user nova-compute[75006]: FIRMWARE:
Nov 27 03:29:31 user nova-compute[75006]: No targets found.
Nov 27 03:29:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:29:31 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:29:31 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5562f4-e5a0-4407-bf79-87fc2a29ebc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a428a-c4f8-4a02-ae99-7b4fa2ed5c9f]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:29:31 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:29:31 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:29:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:29:31 user nova-compute[75006]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:29:31 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:29:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd400756050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d29ca53-46bf-4ba9-a007-c3e9a75da47c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[42667f13-256e-4655-99f6-f0c92fd3b7e5]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e05218-a6cc-4d0c-bf6f-bd226272525b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043c5f8-97a3-4923-9a7e-106befee3bcb]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b6e578-c174-44b4-a794-121cee54b15d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4249ab8d-652d-4981-bdd0-438c4b961757]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260]
Nov 27 03:29:31 user nova-compute[75006]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260] successful.
Nov 27 03:29:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb25b5b2-dbcc-436a-be9e-48414760b1ca]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] <== disconnect_volume: return (321ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:29:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Deleting instance files /opt/stack/data/nova/instances/67512cf7-e06d-406e-ad8b-fcfd6fbbb472_del
Nov 27 03:29:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Deletion of /opt/stack/data/nova/instances/67512cf7-e06d-406e-ad8b-fcfd6fbbb472_del complete
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-ff67a9cc-e5c8-4ff4-9c8d-f583e2ba85b8 req-11873dd2-467f-451a-af11-a0f06f8e8b55 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updated VIF entry in instance network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-ff67a9cc-e5c8-4ff4-9c8d-f583e2ba85b8 req-11873dd2-467f-451a-af11-a0f06f8e8b55 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": null, "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape5137b18-6b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ff67a9cc-e5c8-4ff4-9c8d-f583e2ba85b8 req-11873dd2-467f-451a-af11-a0f06f8e8b55 service nova] Releasing lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:32 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Deleted allocations for instance 67512cf7-e06d-406e-ad8b-fcfd6fbbb472
Nov 27 03:29:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:32 user nova-compute[75006]: DEBUG nova.objects.instance [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lazy-loading 'numa_topology' on Instance uuid 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:29:32 user nova-compute[75006]: DEBUG nova.objects.base [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Object Instance<67512cf7-e06d-406e-ad8b-fcfd6fbbb472> lazy-loaded attributes: resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-eba70e86-6403-4a3e-9bc1-3fa9eb13aa37 req-ae1dae8b-2bae-44db-80e2-6da30b92848c service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-changed-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-eba70e86-6403-4a3e-9bc1-3fa9eb13aa37 req-ae1dae8b-2bae-44db-80e2-6da30b92848c service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Refreshing instance network info cache due to event network-changed-391a7fa7-53fe-41fc-a6c1-e49603ea7c96. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-eba70e86-6403-4a3e-9bc1-3fa9eb13aa37 req-ae1dae8b-2bae-44db-80e2-6da30b92848c service nova] Acquiring lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-eba70e86-6403-4a3e-9bc1-3fa9eb13aa37 req-ae1dae8b-2bae-44db-80e2-6da30b92848c service nova] Acquired lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG nova.network.neutron [req-eba70e86-6403-4a3e-9bc1-3fa9eb13aa37 req-ae1dae8b-2bae-44db-80e2-6da30b92848c service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Refreshing network info cache for port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-29fb3d73-20c1-4a32-b1bc-63a0288edd6a tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.139s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG nova.network.neutron [req-eba70e86-6403-4a3e-9bc1-3fa9eb13aa37 req-ae1dae8b-2bae-44db-80e2-6da30b92848c service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updated VIF entry in instance network info cache for port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG nova.network.neutron [req-eba70e86-6403-4a3e-9bc1-3fa9eb13aa37 req-ae1dae8b-2bae-44db-80e2-6da30b92848c service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating instance_info_cache with network_info: [{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-eba70e86-6403-4a3e-9bc1-3fa9eb13aa37 req-ae1dae8b-2bae-44db-80e2-6da30b92848c service nova] Releasing lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:36 user nova-compute[75006]: INFO nova.compute.manager [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Shelving
Nov 27 03:29:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-a09d611e-0ef4-4f6e-83c6-dcb2b7fee9cb req-ec68801f-b6ce-4c6f-bfe1-f54619ed43ee service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a09d611e-0ef4-4f6e-83c6-dcb2b7fee9cb req-ec68801f-b6ce-4c6f-bfe1-f54619ed43ee service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a09d611e-0ef4-4f6e-83c6-dcb2b7fee9cb req-ec68801f-b6ce-4c6f-bfe1-f54619ed43ee service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a09d611e-0ef4-4f6e-83c6-dcb2b7fee9cb req-ec68801f-b6ce-4c6f-bfe1-f54619ed43ee service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-a09d611e-0ef4-4f6e-83c6-dcb2b7fee9cb req-ec68801f-b6ce-4c6f-bfe1-f54619ed43ee service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:37 user nova-compute[75006]: WARNING nova.compute.manager [req-a09d611e-0ef4-4f6e-83c6-dcb2b7fee9cb req-ec68801f-b6ce-4c6f-bfe1-f54619ed43ee service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state active and task_state shelving.
Nov 27 03:29:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance destroyed successfully.
Nov 27 03:29:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Beginning cold snapshot process
Nov 27 03:29:37 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:29:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk /opt/stack/data/nova/instances/snapshots/tmp48_41o0y/e534344c8f4548bf844fb767c45688a1 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk /opt/stack/data/nova/instances/snapshots/tmp48_41o0y/e534344c8f4548bf844fb767c45688a1" returned: 0 in 0.856s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Snapshot extracted, beginning image upload
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:39 user nova-compute[75006]: WARNING nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:39 user nova-compute[75006]: WARNING nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:39 user nova-compute[75006]: WARNING nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:39 user nova-compute[75006]: WARNING nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:39 user nova-compute[75006]: WARNING nova.compute.manager [req-09da78ae-edf5-4978-b702-5d651050d574 req-2f67eba0-6670-499a-9e4f-a348a9324e62 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 03:29:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Snapshot image upload complete
Nov 27 03:29:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:29:41 user nova-compute[75006]: INFO nova.compute.manager [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Shelve offloading
Nov 27 03:29:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance destroyed successfully.
Nov 27 03:29:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:29:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquired lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:29:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating instance_info_cache with network_info: [{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Releasing lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance destroyed successfully.
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'resources' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-663731875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-663731875',id=27,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2c2VFlgBpGIwKezBrl602UeEXzR+Dbjd2U7k8O4/faonkz0iODXczWyuPBBZpYsA9dCmpvs95jW1H4duBhY91uajCGryA/XBUhb+0JFKyJbhTZ+vCbRL5JtWceoCcMUw==',key_name='tempest-keypair-720199553',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:27:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-awbkwbnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member',shelved_at='2023-11-27T03:29:41.282760',shelved_host='user',shelved_image_id='eddda39c-5dba-4e00-abc7-33b54b693a87'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:29:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=1556b696-96e5-4cd6-9246-3673235d47fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG os_vif [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391a7fa7-53, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7791cffd-c607-4c54-b8ca-efcd73390479) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-0f9d199a-f899-4ea8-b674-ff7735b4ba58 req-26392db1-74bf-41b1-8566-ece38b504062 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-changed-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-0f9d199a-f899-4ea8-b674-ff7735b4ba58 req-26392db1-74bf-41b1-8566-ece38b504062 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Refreshing instance network info cache due to event network-changed-391a7fa7-53fe-41fc-a6c1-e49603ea7c96. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0f9d199a-f899-4ea8-b674-ff7735b4ba58 req-26392db1-74bf-41b1-8566-ece38b504062 service nova] Acquiring lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0f9d199a-f899-4ea8-b674-ff7735b4ba58 req-26392db1-74bf-41b1-8566-ece38b504062 service nova] Acquired lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-0f9d199a-f899-4ea8-b674-ff7735b4ba58 req-26392db1-74bf-41b1-8566-ece38b504062 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Refreshing network info cache for port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:29:42 user nova-compute[75006]: INFO os_vif [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53')
Nov 27 03:29:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Deleting instance files /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc_del
Nov 27 03:29:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Deletion of /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc_del complete
Nov 27 03:29:42 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Deleted allocations for instance 1556b696-96e5-4cd6-9246-3673235d47fc
Nov 27 03:29:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'numa_topology' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.objects.base [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<1556b696-96e5-4cd6-9246-3673235d47fc> lazy-loaded attributes: resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-0f9d199a-f899-4ea8-b674-ff7735b4ba58 req-26392db1-74bf-41b1-8566-ece38b504062 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updated VIF entry in instance network info cache for port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-0f9d199a-f899-4ea8-b674-ff7735b4ba58 req-26392db1-74bf-41b1-8566-ece38b504062 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating instance_info_cache with network_info: [{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap391a7fa7-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0f9d199a-f899-4ea8-b674-ff7735b4ba58 req-26392db1-74bf-41b1-8566-ece38b504062 service nova] Releasing lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0240aefa-95c4-4292-a093-b871f6b6b7fe tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.254s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:50 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:50 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:29:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:29:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updating instance_info_cache with network_info: [{"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:29:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:29:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7305MB free_disk=25.2901611328125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:58 user nova-compute[75006]: INFO nova.compute.manager [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Rescuing
Nov 27 03:29:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquired lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 20805ff8-bf32-4d64-8380-472195a9119a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6990b476-cfd5-43c0-a295-5ee42393d35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updating instance_info_cache with network_info: [{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Releasing lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-02738bae-6f8f-4527-abed-d4f0d9124da4 req-bbefcec0-5a81-43de-8509-7d73ba5b907f service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-02738bae-6f8f-4527-abed-d4f0d9124da4 req-bbefcec0-5a81-43de-8509-7d73ba5b907f service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-02738bae-6f8f-4527-abed-d4f0d9124da4 req-bbefcec0-5a81-43de-8509-7d73ba5b907f service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-02738bae-6f8f-4527-abed-d4f0d9124da4 req-bbefcec0-5a81-43de-8509-7d73ba5b907f service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-02738bae-6f8f-4527-abed-d4f0d9124da4 req-bbefcec0-5a81-43de-8509-7d73ba5b907f service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:29:59 user nova-compute[75006]: WARNING nova.compute.manager [req-02738bae-6f8f-4527-abed-d4f0d9124da4 req-bbefcec0-5a81-43de-8509-7d73ba5b907f service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state active and task_state rescuing.
Nov 27 03:29:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance destroyed successfully.
Nov 27 03:29:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Attempting a stable device rescue
Nov 27 03:29:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75006) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance directory exists: not creating {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 03:29:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Creating image(s)
Nov 27 03:29:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "/opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "/opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "/opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'trusted_certs' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "4c118ec9f69ee550053e2222541010f46e184cb2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:29:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "4c118ec9f69ee550053e2222541010f46e184cb2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG nova.virt.images [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] 835ccea2-5dd6-4d56-a77a-37526e574618 was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2.part /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2.part /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2.converted" returned: 0 in 0.220s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "4c118ec9f69ee550053e2222541010f46e184cb2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.486s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "4c118ec9f69ee550053e2222541010f46e184cb2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "4c118ec9f69ee550053e2222541010f46e184cb2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2 --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2,backing_fmt=raw /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.rescue {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2,backing_fmt=raw /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.rescue" returned: 0 in 0.052s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "4c118ec9f69ee550053e2222541010f46e184cb2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'migration_context' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<55bfa775-09a3-40d5-a361-8c88466bfeb2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Start _get_guest_xml network_info=[{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "vif_mac": "fa:16:3e:54:aa:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '835ccea2-5dd6-4d56-a77a-37526e574618', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '2491488d-e7f7-477b-9fa6-cb007e8458ff', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcNGHyAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '55bfa775-09a3-40d5-a361-8c88466bfeb2', 'attached_at': '', 'detached_at': '', 'volume_id': '257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'serial': '257d1601-7eb5-4be0-8c2c-561dd6c7935b'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'resources' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<55bfa775-09a3-40d5-a361-8c88466bfeb2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'numa_topology' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<55bfa775-09a3-40d5-a361-8c88466bfeb2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:30:01 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:30:01 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-5f10114a-7c11-4fd7-b9a6-6e2cf411ec8d req-8c3d1ecd-72c1-497a-aaa4-70a4eee9e8eb service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f10114a-7c11-4fd7-b9a6-6e2cf411ec8d req-8c3d1ecd-72c1-497a-aaa4-70a4eee9e8eb service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f10114a-7c11-4fd7-b9a6-6e2cf411ec8d req-8c3d1ecd-72c1-497a-aaa4-70a4eee9e8eb service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5f10114a-7c11-4fd7-b9a6-6e2cf411ec8d req-8c3d1ecd-72c1-497a-aaa4-70a4eee9e8eb service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-5f10114a-7c11-4fd7-b9a6-6e2cf411ec8d req-8c3d1ecd-72c1-497a-aaa4-70a4eee9e8eb service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:01 user nova-compute[75006]: WARNING nova.compute.manager [req-5f10114a-7c11-4fd7-b9a6-6e2cf411ec8d req-8c3d1ecd-72c1-497a-aaa4-70a4eee9e8eb service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state active and task_state rescuing.
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<55bfa775-09a3-40d5-a361-8c88466bfeb2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcNGHyAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:01 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:01 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:01 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[98944cda-30ed-4592-810e-a788a6962cac]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RcNGHyAe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 03:30:01 user nova-compute[75006]: node.name = iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:30:01 user nova-compute[75006]: node.tpgt = -1
Nov 27 03:30:01 user nova-compute[75006]: node.startup = automatic
Nov 27 03:30:01 user nova-compute[75006]: node.leading_login = No
Nov 27 03:30:01 user nova-compute[75006]: iface.iscsi_ifacename = default
Nov 27 03:30:01 user nova-compute[75006]: iface.net_ifacename = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.ipaddress = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.prefix_len = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.hwaddress = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.transport_name = tcp
Nov 27 03:30:01 user nova-compute[75006]: iface.initiatorname = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.state = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.vlan_id = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.vlan_priority = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.vlan_state = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.iface_num = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.mtu = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.port = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.bootproto = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.subnet_mask = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.gateway = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.dhcp_alt_client_id = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.dhcp_dns = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.dhcp_learn_iqn = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.dhcp_vendor_id_state = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.dhcp_vendor_id = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.dhcp_slp_da = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.fragmentation = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.gratuitous_arp = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.incoming_forwarding = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.tos_state = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.tos = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.ttl = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.delayed_ack = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.tcp_nagle = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.tcp_wsf_state = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.tcp_wsf = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.tcp_timer_scale = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.tcp_timestamp = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.redirect = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.def_task_mgmt_timeout = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.header_digest = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.data_digest = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.immediate_data = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.initial_r2t = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.data_seq_inorder = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.data_pdu_inorder = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.erl = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.max_receive_data_len = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.first_burst_len = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.max_outstanding_r2t = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.max_burst_len = 0
Nov 27 03:30:01 user nova-compute[75006]: iface.chap_auth = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.bidi_chap = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.strict_login_compliance = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.discovery_auth = <empty>
Nov 27 03:30:01 user nova-compute[75006]: iface.discovery_logout = <empty>
Nov 27 03:30:01 user nova-compute[75006]: node.discovery_address = <empty>
Nov 27 03:30:01 user nova-compute[75006]: node.discovery_port = 0
Nov 27 03:30:01 user nova-compute[75006]: node.discovery_type = static
Nov 27 03:30:01 user nova-compute[75006]: node.session.initial_cmdsn = 0
Nov 27 03:30:01 user nova-compute[75006]: node.session.initial_login_retry_max = 8
Nov 27 03:30:01 user nova-compute[75006]: node.session.xmit_thread_priority = -20
Nov 27 03:30:01 user nova-compute[75006]: node.session.cmds_max = 128
Nov 27 03:30:01 user nova-compute[75006]: node.session.queue_depth = 32
Nov 27 03:30:01 user nova-compute[75006]: node.session.nr_sessions = 1
Nov 27 03:30:01 user nova-compute[75006]: node.session.auth.authmethod = CHAP
Nov 27 03:30:01 user nova-compute[75006]: node.session.auth.username = RcNGHyAe
Nov 27 03:30:01 user nova-compute[75006]: node.session.auth.password = ***
Nov 27 03:30:01 user nova-compute[75006]: node.session.auth.username_in = <empty>
Nov 27 03:30:01 user nova-compute[75006]: node.session.auth.password_in = <empty>
Nov 27 03:30:01 user nova-compute[75006]: node.session.auth.chap_algs = MD5
Nov 27 03:30:01 user nova-compute[75006]: node.session.timeo.replacement_timeout = 120
Nov 27 03:30:01 user nova-compute[75006]: node.session.err_timeo.abort_timeout = 15
Nov 27 03:30:01 user nova-compute[75006]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 03:30:01 user nova-compute[75006]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 03:30:01 user nova-compute[75006]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.FastAbort = Yes
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.InitialR2T = No
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.ImmediateData = Yes
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.MaxConnections = 1
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 03:30:01 user nova-compute[75006]: node.session.iscsi.ERL = 0
Nov 27 03:30:01 user nova-compute[75006]: node.session.scan = manual
Nov 27 03:30:01 user nova-compute[75006]: node.session.reopen_max = 0
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].address = 172.16.0.220
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].port = 3260
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].startup = manual
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].tcp.window_size = 524288
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].tcp.type_of_service = 0
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].timeo.logout_timeout = 15
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].timeo.login_timeout = 15
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].timeo.auth_timeout = 45
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].iscsi.DataDigest = None
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].iscsi.IFMarker = No
Nov 27 03:30:01 user nova-compute[75006]: node.conn[0].iscsi.OFMarker = No
Nov 27 03:30:01 user nova-compute[75006]: # END RECORD
Nov 27 03:30:01 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a12238-4f02-401e-845b-f0190361e2af]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bcc502-2bbc-4694-a649-475f49fa368a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcNGHyAe {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RcNGHyAe" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e775d44d-ee16-4b4b-acb1-e0273fbcb95d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RcNGHyAe'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e4c49a-5654-48ca-aac7-ed17ed3f8b46]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[199a04cd-4462-4ff0-8f41-00890b6c29a0]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:01 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:01 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:01 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:01 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] HCTL ('34', '0', '0', 0) found on session 32 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb1371-bd60-4a5c-9c83-941ce03679f7]: (4, ('0 0 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching for a device in session 32 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcNGHyAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.161s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] <== connect_volume: return (162ms) {'type': 'block', 'scsi_wwn': '26137303963636336', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137303963636336', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2086826292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2086826292',id=28,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:28:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-eis90tv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:28:27Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=55bfa775-09a3-40d5-a361-8c88466bfeb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "vif_mac": "fa:16:3e:54:aa:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "vif_mac": "fa:16:3e:54:aa:0f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:aa:0f,bridge_name='br-int',has_traffic_filtering=True,id=4d688103-30d3-4ec5-a22b-25f45607dfa8,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d688103-30') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'pci_devices' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.objects.base [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<55bfa775-09a3-40d5-a361-8c88466bfeb2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:30:01 user nova-compute[75006]:   <uuid>55bfa775-09a3-40d5-a361-8c88466bfeb2</uuid>
Nov 27 03:30:01 user nova-compute[75006]:   <name>instance-0000001c</name>
Nov 27 03:30:01 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:30:01 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:30:01 user nova-compute[75006]:   <metadata>
Nov 27 03:30:01 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:30:01 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:30:01 user nova-compute[75006]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2086826292</nova:name>
Nov 27 03:30:01 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:30:01</nova:creationTime>
Nov 27 03:30:01 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:30:01 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:30:01 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:30:01 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:30:01 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:30:01 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:30:01 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:30:01 user nova-compute[75006]:       <nova:owner>
Nov 27 03:30:01 user nova-compute[75006]:         <nova:user uuid="7bdc7ee98a95432d96679fc697b7d61d">tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member</nova:user>
Nov 27 03:30:01 user nova-compute[75006]:         <nova:project uuid="03bbdcea84574886bbea67eefc84dca0">tempest-ServerBootFromVolumeStableRescueTest-2135085811</nova:project>
Nov 27 03:30:01 user nova-compute[75006]:       </nova:owner>
Nov 27 03:30:01 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:30:01 user nova-compute[75006]:       <nova:ports>
Nov 27 03:30:01 user nova-compute[75006]:         <nova:port uuid="4d688103-30d3-4ec5-a22b-25f45607dfa8">
Nov 27 03:30:01 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 03:30:01 user nova-compute[75006]:         </nova:port>
Nov 27 03:30:01 user nova-compute[75006]:       </nova:ports>
Nov 27 03:30:01 user nova-compute[75006]:     </nova:instance>
Nov 27 03:30:01 user nova-compute[75006]:   </metadata>
Nov 27 03:30:01 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:30:01 user nova-compute[75006]:     <system>
Nov 27 03:30:01 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:30:01 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:30:01 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:30:01 user nova-compute[75006]:       <entry name="serial">55bfa775-09a3-40d5-a361-8c88466bfeb2</entry>
Nov 27 03:30:01 user nova-compute[75006]:       <entry name="uuid">55bfa775-09a3-40d5-a361-8c88466bfeb2</entry>
Nov 27 03:30:01 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:30:01 user nova-compute[75006]:     </system>
Nov 27 03:30:01 user nova-compute[75006]:   </sysinfo>
Nov 27 03:30:01 user nova-compute[75006]:   <os>
Nov 27 03:30:01 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:30:01 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:30:01 user nova-compute[75006]:   </os>
Nov 27 03:30:01 user nova-compute[75006]:   <features>
Nov 27 03:30:01 user nova-compute[75006]:     <acpi/>
Nov 27 03:30:01 user nova-compute[75006]:     <apic/>
Nov 27 03:30:01 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:30:01 user nova-compute[75006]:   </features>
Nov 27 03:30:01 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:30:01 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:30:01 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:30:01 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:30:01 user nova-compute[75006]:   </clock>
Nov 27 03:30:01 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:30:01 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:30:01 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:30:01 user nova-compute[75006]:   </cpu>
Nov 27 03:30:01 user nova-compute[75006]:   <devices>
Nov 27 03:30:01 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:30:01 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:01 user nova-compute[75006]:       <source dev="/dev/sdc"/>
Nov 27 03:30:01 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:30:01 user nova-compute[75006]:       <serial>257d1601-7eb5-4be0-8c2c-561dd6c7935b</serial>
Nov 27 03:30:01 user nova-compute[75006]:     </disk>
Nov 27 03:30:01 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:30:01 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:30:01 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.rescue"/>
Nov 27 03:30:01 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:30:01 user nova-compute[75006]:       <boot order="1"/>
Nov 27 03:30:01 user nova-compute[75006]:     </disk>
Nov 27 03:30:01 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:30:01 user nova-compute[75006]:       <mac address="fa:16:3e:54:aa:0f"/>
Nov 27 03:30:01 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:30:01 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:30:01 user nova-compute[75006]:       <target dev="tap4d688103-30"/>
Nov 27 03:30:01 user nova-compute[75006]:     </interface>
Nov 27 03:30:01 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:30:01 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/console.log" append="off"/>
Nov 27 03:30:01 user nova-compute[75006]:     </serial>
Nov 27 03:30:01 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:30:01 user nova-compute[75006]:     <video>
Nov 27 03:30:01 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:30:01 user nova-compute[75006]:     </video>
Nov 27 03:30:01 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:30:01 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:30:01 user nova-compute[75006]:     </rng>
Nov 27 03:30:01 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:30:01 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:30:01 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:30:01 user nova-compute[75006]:     </memballoon>
Nov 27 03:30:01 user nova-compute[75006]:   </devices>
Nov 27 03:30:01 user nova-compute[75006]: </domain>
Nov 27 03:30:01 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:30:01 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance destroyed successfully.
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No VIF found with MAC fa:16:3e:54:aa:0f, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-e275bf10-87b7-420d-931a-3bc6ffac695b req-74b6b56c-5de0-46ce-90e3-245efaa0b391 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received event network-changed-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-e275bf10-87b7-420d-931a-3bc6ffac695b req-74b6b56c-5de0-46ce-90e3-245efaa0b391 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Refreshing instance network info cache due to event network-changed-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e275bf10-87b7-420d-931a-3bc6ffac695b req-74b6b56c-5de0-46ce-90e3-245efaa0b391 service nova] Acquiring lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e275bf10-87b7-420d-931a-3bc6ffac695b req-74b6b56c-5de0-46ce-90e3-245efaa0b391 service nova] Acquired lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG nova.network.neutron [req-e275bf10-87b7-420d-931a-3bc6ffac695b req-74b6b56c-5de0-46ce-90e3-245efaa0b391 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Refreshing network info cache for port 2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG nova.objects.instance [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'flavor' on Instance uuid ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Ignoring supplied device name: /dev/vdb
Nov 27 03:30:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-e275bf10-87b7-420d-931a-3bc6ffac695b req-74b6b56c-5de0-46ce-90e3-245efaa0b391 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Updated VIF entry in instance network info cache for port 2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-e275bf10-87b7-420d-931a-3bc6ffac695b req-74b6b56c-5de0-46ce-90e3-245efaa0b391 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Updating instance_info_cache with network_info: [{"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e275bf10-87b7-420d-931a-3bc6ffac695b req-74b6b56c-5de0-46ce-90e3-245efaa0b391 service nova] Releasing lock "refresh_cache-ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:03 user nova-compute[75006]: INFO nova.compute.manager [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Attaching volume 7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 to /dev/vdb
Nov 27 03:30:03 user nova-compute[75006]: DEBUG os_brick.utils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[23266a70-99ce-45fa-82bd-ae497a5234d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492f84c-d235-4965-97cf-0af1511d7001]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9f0893-1a53-4486-9324-74cc7afeb0cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cf0c64-eb52-4204-a6f2-c6046a64e0e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:30:03 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[736fadc4-d0b6-43f9-886c-c8e7af0acdc3]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG os_brick.utils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Updating existing volume attachment record: 2bc19631-3907-4180-8845-462ee8443809 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-1a51ee02-c586-404f-b572-ac4259de6ee4 req-aae02794-34fc-4871-a53c-17b99603cdb6 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1a51ee02-c586-404f-b572-ac4259de6ee4 req-aae02794-34fc-4871-a53c-17b99603cdb6 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1a51ee02-c586-404f-b572-ac4259de6ee4 req-aae02794-34fc-4871-a53c-17b99603cdb6 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1a51ee02-c586-404f-b572-ac4259de6ee4 req-aae02794-34fc-4871-a53c-17b99603cdb6 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-1a51ee02-c586-404f-b572-ac4259de6ee4 req-aae02794-34fc-4871-a53c-17b99603cdb6 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:03 user nova-compute[75006]: WARNING nova.compute.manager [req-1a51ee02-c586-404f-b572-ac4259de6ee4 req-aae02794-34fc-4871-a53c-17b99603cdb6 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state active and task_state rescuing.
Nov 27 03:30:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0d9dbccd-d184-4668-9661-21d5c426fea1 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:30:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-ddf4639d-c3c2-430f-8138-640c0d44a270 req-287b4098-86ef-4b37-8534-4f62f037735f service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ddf4639d-c3c2-430f-8138-640c0d44a270 req-287b4098-86ef-4b37-8534-4f62f037735f service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ddf4639d-c3c2-430f-8138-640c0d44a270 req-287b4098-86ef-4b37-8534-4f62f037735f service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ddf4639d-c3c2-430f-8138-640c0d44a270 req-287b4098-86ef-4b37-8534-4f62f037735f service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-ddf4639d-c3c2-430f-8138-640c0d44a270 req-287b4098-86ef-4b37-8534-4f62f037735f service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:05 user nova-compute[75006]: WARNING nova.compute.manager [req-ddf4639d-c3c2-430f-8138-640c0d44a270 req-287b4098-86ef-4b37-8534-4f62f037735f service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state None.
Nov 27 03:30:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRAyDfbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:09 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[66995d67-92b2-4bcc-b261-416a17f186d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:30:09 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2d2a05-06b9-4194-8778-63e9bb2c68a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1] added
Nov 27 03:30:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb008fc-fcc6-46db-aa90-81933343f6e2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7f625d-36d3-4b9b-872a-f35bdcaf4a08]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRAyDfbk {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KRAyDfbk" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d5c565-a48d-46c9-97cf-fb6c7ba58df8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KRAyDfbk'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[192713a8-867c-4e7c-b001-c1653eb50b4e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[864a3a8a-21a8-452d-bf8d-0dae7829b204]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:09 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:09 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f157a7b4-39ea-4f92-a082-cf230aacbf22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1, portal: 172.16.0.220,3260]
Nov 27 03:30:09 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1, portal: 172.16.0.220,3260] successful.
Nov 27 03:30:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7121a035-7319-489a-97f2-ea823d679f7e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[da322b14-d1b4-421c-bdf3-50fb88d2cc7c]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:09 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:09 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:09 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:09 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda59a6b-b12c-4ebd-86a6-3c587d9a1858]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:30:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRAyDfbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:30:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23236353936656434', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236353936656434', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:30:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'flavor' on Instance uuid ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:30:10 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:10 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:30:10 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:30:10 user nova-compute[75006]:   <serial>7c083b5d-b3e0-44ea-a55a-8b8fcee637c1</serial>
Nov 27 03:30:10 user nova-compute[75006]: </disk>
Nov 27 03:30:10 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:30:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] No VIF found with MAC fa:16:3e:7f:77:55, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:30:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-49281e5d-482f-4210-9647-ac223083abc2 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.246s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-2a7f9a70-8ff6-45ae-a0f0-bfa17f3209cd req-8ca185f1-dd7f-4ef8-aa7e-c49acbfa3167 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received event network-changed-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-2a7f9a70-8ff6-45ae-a0f0-bfa17f3209cd req-8ca185f1-dd7f-4ef8-aa7e-c49acbfa3167 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Refreshing instance network info cache due to event network-changed-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2a7f9a70-8ff6-45ae-a0f0-bfa17f3209cd req-8ca185f1-dd7f-4ef8-aa7e-c49acbfa3167 service nova] Acquiring lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2a7f9a70-8ff6-45ae-a0f0-bfa17f3209cd req-8ca185f1-dd7f-4ef8-aa7e-c49acbfa3167 service nova] Acquired lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:30:17 user nova-compute[75006]: DEBUG nova.network.neutron [req-2a7f9a70-8ff6-45ae-a0f0-bfa17f3209cd req-8ca185f1-dd7f-4ef8-aa7e-c49acbfa3167 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Refreshing network info cache for port 87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:30:18 user nova-compute[75006]: DEBUG nova.network.neutron [req-2a7f9a70-8ff6-45ae-a0f0-bfa17f3209cd req-8ca185f1-dd7f-4ef8-aa7e-c49acbfa3167 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Updated VIF entry in instance network info cache for port 87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:30:18 user nova-compute[75006]: DEBUG nova.network.neutron [req-2a7f9a70-8ff6-45ae-a0f0-bfa17f3209cd req-8ca185f1-dd7f-4ef8-aa7e-c49acbfa3167 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Updating instance_info_cache with network_info: [{"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:30:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2a7f9a70-8ff6-45ae-a0f0-bfa17f3209cd req-8ca185f1-dd7f-4ef8-aa7e-c49acbfa3167 service nova] Releasing lock "refresh_cache-20805ff8-bf32-4d64-8380-472195a9119a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:30:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG nova.objects.instance [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid 20805ff8-bf32-4d64-8380-472195a9119a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:20 user nova-compute[75006]: INFO nova.compute.manager [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Attaching volume 1bfa71c9-30fb-46c7-b4f6-032c5cff1383 to /dev/vdb
Nov 27 03:30:20 user nova-compute[75006]: DEBUG os_brick.utils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf78bc9-fe01-464e-bda9-6c0f71e146b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74a2fbc-0908-4d58-8119-f722e0627008]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a087537-661e-4b90-b7dd-23a0dcd22a1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ae3bb-acdf-4120-a3f2-44f9b8c1cb99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:30:20 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:30:20 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61489bf-f4ec-4f15-833e-31a534145944]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG os_brick.utils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:20 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Updating existing volume attachment record: 871a93e2-8da2-4038-8bbc-41642d943299 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:30:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbICPBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:26 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:26 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:26 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bada13a-734d-4375-9fea-25d6861f9f1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:30:26 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5021993-3bb7-4428-94e1-d662e3d42ed4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383] added
Nov 27 03:30:26 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d5303d-ce19-455a-969e-0d5eb70f9cb0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fa42ea-15b0-43df-893e-3a029e4a0139]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbICPBhO {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbICPBhO" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41b0565-91be-4266-944a-a8b12c487650]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xbICPBhO'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a71843-41e5-429a-a56b-212456f06a4f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dff35d-c786-4283-ba1f-6a65315a41da]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2b8c07-a834-428b-885d-d3b5712cb56f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383, portal: 172.16.0.220,3260]
Nov 27 03:30:27 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383, portal: 172.16.0.220,3260] successful.
Nov 27 03:30:27 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fb06a8-9dc8-4f82-b231-ac4398db2bb6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e3494d-9329-4a2a-9762-5c6f15080877]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:27 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4146a09f-1968-4eee-a769-e0c89cd27436]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbICPBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:30:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26433373437323533', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433373437323533', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:30:28 user nova-compute[75006]: INFO nova.compute.manager [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Detaching volume 7c083b5d-b3e0-44ea-a55a-8b8fcee637c1
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.objects.instance [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid 20805ff8-bf32-4d64-8380-472195a9119a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:30:28 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:28 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:30:28 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:30:28 user nova-compute[75006]:   <serial>1bfa71c9-30fb-46c7-b4f6-032c5cff1383</serial>
Nov 27 03:30:28 user nova-compute[75006]: </disk>
Nov 27 03:30:28 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:30:28 user nova-compute[75006]: INFO nova.virt.block_device [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Attempting to driver detach volume 7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 from mountpoint /dev/vdb
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Attempting to detach device vdb from instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:30:28 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:28 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:30:28 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:30:28 user nova-compute[75006]:   <serial>7c083b5d-b3e0-44ea-a55a-8b8fcee637c1</serial>
Nov 27 03:30:28 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:30:28 user nova-compute[75006]: </disk>
Nov 27 03:30:28 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:30:28 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Successfully detached device vdb from instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa from the persistent domain config.
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:30:28 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:28 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:30:28 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:30:28 user nova-compute[75006]:   <serial>7c083b5d-b3e0-44ea-a55a-8b8fcee637c1</serial>
Nov 27 03:30:28 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:30:28 user nova-compute[75006]: </disk>
Nov 27 03:30:28 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] No VIF found with MAC fa:16:3e:d1:bb:d8, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f4c23042-3972-432a-a217-a242f3bc1088 tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.229s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:28 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:30:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:29 user nova-compute[75006]: INFO nova.compute.manager [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Detaching volume 1bfa71c9-30fb-46c7-b4f6-032c5cff1383
Nov 27 03:30:29 user nova-compute[75006]: INFO nova.virt.block_device [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Attempting to driver detach volume 1bfa71c9-30fb-46c7-b4f6-032c5cff1383 from mountpoint /dev/vdb
Nov 27 03:30:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Attempting to detach device vdb from instance 20805ff8-bf32-4d64-8380-472195a9119a from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:30:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:30:29 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:29 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:30:29 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:30:29 user nova-compute[75006]:   <serial>1bfa71c9-30fb-46c7-b4f6-032c5cff1383</serial>
Nov 27 03:30:29 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:30:29 user nova-compute[75006]: </disk>
Nov 27 03:30:29 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:30:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:29 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully detached device vdb from instance 20805ff8-bf32-4d64-8380-472195a9119a from the persistent domain config.
Nov 27 03:30:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20805ff8-bf32-4d64-8380-472195a9119a from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:30:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:30:29 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:29 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:30:29 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:30:29 user nova-compute[75006]:   <serial>1bfa71c9-30fb-46c7-b4f6-032c5cff1383</serial>
Nov 27 03:30:29 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:30:29 user nova-compute[75006]: </disk>
Nov 27 03:30:29 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:30:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20805ff8-bf32-4d64-8380-472195a9119a {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:30:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-be2124d3-b296-4b3c-ada7-09af4775111f req-ddf0e547-d1ef-44bb-8c75-49f662623f31 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received event network-changed-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-be2124d3-b296-4b3c-ada7-09af4775111f req-ddf0e547-d1ef-44bb-8c75-49f662623f31 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Refreshing instance network info cache due to event network-changed-88559c16-3699-43f5-968a-bf65e5cf194b. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:30:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be2124d3-b296-4b3c-ada7-09af4775111f req-ddf0e547-d1ef-44bb-8c75-49f662623f31 service nova] Acquiring lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:30:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be2124d3-b296-4b3c-ada7-09af4775111f req-ddf0e547-d1ef-44bb-8c75-49f662623f31 service nova] Acquired lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:30:34 user nova-compute[75006]: DEBUG nova.network.neutron [req-be2124d3-b296-4b3c-ada7-09af4775111f req-ddf0e547-d1ef-44bb-8c75-49f662623f31 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Refreshing network info cache for port 88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:30:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:34 user nova-compute[75006]: DEBUG nova.network.neutron [req-be2124d3-b296-4b3c-ada7-09af4775111f req-ddf0e547-d1ef-44bb-8c75-49f662623f31 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Updated VIF entry in instance network info cache for port 88559c16-3699-43f5-968a-bf65e5cf194b. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:30:34 user nova-compute[75006]: DEBUG nova.network.neutron [req-be2124d3-b296-4b3c-ada7-09af4775111f req-ddf0e547-d1ef-44bb-8c75-49f662623f31 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Updating instance_info_cache with network_info: [{"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:30:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be2124d3-b296-4b3c-ada7-09af4775111f req-ddf0e547-d1ef-44bb-8c75-49f662623f31 service nova] Releasing lock "refresh_cache-8bad1d7e-9d3c-4c63-b47a-634b4874d791" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG nova.objects.instance [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:37 user nova-compute[75006]: INFO nova.compute.manager [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Terminating instance
Nov 27 03:30:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:37 user nova-compute[75006]: INFO nova.compute.manager [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Attaching volume 1c67425a-7562-4e78-a88d-2d1105dbec71 to /dev/vdb
Nov 27 03:30:37 user nova-compute[75006]: DEBUG os_brick.utils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97cc906-507b-4dc3-9c29-3ae5f45ff435]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7065027a-48f8-49b3-a226-7d36dbfab2a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f0529-1a37-4fb0-b1b2-36430edef315]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[84635370-0c7e-491c-9530-2f7699948c11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-bbaa94a7-287c-4d24-826a-76088d1fce4f req-c669278e-759e-4801-97d1-b3491fa44906 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bbaa94a7-287c-4d24-826a-76088d1fce4f req-c669278e-759e-4801-97d1-b3491fa44906 service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bbaa94a7-287c-4d24-826a-76088d1fce4f req-c669278e-759e-4801-97d1-b3491fa44906 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bbaa94a7-287c-4d24-826a-76088d1fce4f req-c669278e-759e-4801-97d1-b3491fa44906 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-bbaa94a7-287c-4d24-826a-76088d1fce4f req-c669278e-759e-4801-97d1-b3491fa44906 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-bbaa94a7-287c-4d24-826a-76088d1fce4f req-c669278e-759e-4801-97d1-b3491fa44906 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-unplugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:30:37 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:30:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d408f39-6a01-42c1-aef4-da51a961c860]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG os_brick.utils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:37 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Updating existing volume attachment record: 40d2fbee-c953-4dd1-af85-4ac7aa7307e1 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:30:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Instance destroyed successfully.
Nov 27 03:30:38 user nova-compute[75006]: DEBUG nova.objects.instance [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lazy-loading 'resources' on Instance uuid e8860f63-c6ce-43ee-8c6e-6eea89d901d1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:21:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-908294320',display_name='tempest-ServerActionsTestOtherB-server-908294320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-908294320',id=17,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdc2LVQZRbncs+GOcYrrexKxochKmDBuFznYuQ6tpQyzBLgXom4lo7xr/0pWwnwWseGrh5IV8I+DihCXyYBQmEizOL/LF5NEA3LzzVe2H0tu9j1YAylULFniZMc5m4ilw==',key_name='tempest-keypair-1710316956',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00ce3c8acb7748f8af5dce8fc3f02ebe',ramdisk_id='',reservation_id='r-ztmq42yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1115240976',owner_user_name='tempest-ServerActionsTestOtherB-1115240976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:28:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8df2fba5f3724b2fb210eef7331a2dcd',uuid=e8860f63-c6ce-43ee-8c6e-6eea89d901d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converting VIF {"id": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "address": "fa:16:3e:d9:f7:5f", "network": {"id": "9932d56e-4bfc-4bca-8634-e8ab35ee2c67", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-805329585-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00ce3c8acb7748f8af5dce8fc3f02ebe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01db2ae6-9b", "ovs_interfaceid": "01db2ae6-9b70-456e-aaa3-ecec258c0a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_vif [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01db2ae6-9b, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74baf78a-af24-4513-964f-b22c9e6985a6) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:30:38 user nova-compute[75006]: INFO os_vif [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f7:5f,bridge_name='br-int',has_traffic_filtering=True,id=01db2ae6-9b70-456e-aaa3-ecec258c0a00,network=Network(9932d56e-4bfc-4bca-8634-e8ab35ee2c67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01db2ae6-9b')
Nov 27 03:30:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqFPOaxz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:38 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9186336d-83d7-42e5-a3df-9fecee0a16ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:30:38 user nova-compute[75006]: No targets found.
Nov 27 03:30:38 user nova-compute[75006]: iSNS:
Nov 27 03:30:38 user nova-compute[75006]: No targets found.
Nov 27 03:30:38 user nova-compute[75006]: STATIC:
Nov 27 03:30:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7
Nov 27 03:30:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:30:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1
Nov 27 03:30:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:38 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383
Nov 27 03:30:38 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:38 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:38 user nova-compute[75006]: FIRMWARE:
Nov 27 03:30:38 user nova-compute[75006]: No targets found.
Nov 27 03:30:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:30:38 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:30:38 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d336300-5d70-4a1f-b9ee-2313da93e878]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf8a7ae-b289-457e-8712-fe17aba3cfeb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:38 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:38 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:38 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 (non-flash)
Nov 27 03:30:38 user nova-compute[75006]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:38 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:38 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae55e33-03a0-40a8-a6dd-30eff9a9676e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0149c9b3-ee15-4bc6-b582-9a0dfb6f77e9]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb5e5e4-fdb4-4f03-8a20-eda4f385b527]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19241535-a4ad-47c3-b4ce-63525c6084a5]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b4c307-c531-4145-a1cc-0482be173a4f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9c0d49-c28e-4354-a0b4-5277e6c4f50c]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260]
Nov 27 03:30:38 user nova-compute[75006]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7, portal: 172.16.0.220,3260] successful.
Nov 27 03:30:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be037b90-f73b-4a57-a875-6944371554e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e01164-6cb2-4e9f-8aea-fc9d48c21426]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] <== disconnect_volume: return (308ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:30:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Deleting instance files /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1_del
Nov 27 03:30:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Deletion of /opt/stack/data/nova/instances/e8860f63-c6ce-43ee-8c6e-6eea89d901d1_del complete
Nov 27 03:30:38 user nova-compute[75006]: INFO nova.compute.manager [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 27 03:30:38 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:30:38 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:30:39 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:30:39 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Took 0.65 seconds to deallocate network for instance.
Nov 27 03:30:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-b96cb5d8-93c1-4cff-9b60-365a8c2e2792 req-116980df-db68-41d9-884f-8ab25ed26e52 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b96cb5d8-93c1-4cff-9b60-365a8c2e2792 req-116980df-db68-41d9-884f-8ab25ed26e52 service nova] Acquiring lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b96cb5d8-93c1-4cff-9b60-365a8c2e2792 req-116980df-db68-41d9-884f-8ab25ed26e52 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b96cb5d8-93c1-4cff-9b60-365a8c2e2792 req-116980df-db68-41d9-884f-8ab25ed26e52 service nova] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-b96cb5d8-93c1-4cff-9b60-365a8c2e2792 req-116980df-db68-41d9-884f-8ab25ed26e52 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] No waiting events found dispatching network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:39 user nova-compute[75006]: WARNING nova.compute.manager [req-b96cb5d8-93c1-4cff-9b60-365a8c2e2792 req-116980df-db68-41d9-884f-8ab25ed26e52 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received unexpected event network-vif-plugged-01db2ae6-9b70-456e-aaa3-ecec258c0a00 for instance with vm_state active and task_state deleting.
Nov 27 03:30:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-b96cb5d8-93c1-4cff-9b60-365a8c2e2792 req-116980df-db68-41d9-884f-8ab25ed26e52 service nova] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Received event network-vif-deleted-01db2ae6-9b70-456e-aaa3-ecec258c0a00 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:39 user nova-compute[75006]: INFO nova.compute.manager [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] [instance: e8860f63-c6ce-43ee-8c6e-6eea89d901d1] Took 0.77 seconds to detach 1 volumes for instance.
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.341s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:30:40 user nova-compute[75006]: INFO nova.compute.claims [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Claim successful on node user
Nov 27 03:30:40 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Deleted allocations for instance e8860f63-c6ce-43ee-8c6e-6eea89d901d1
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2e354bfd-0a9f-4118-a6cc-1c1098416c1f tempest-ServerActionsTestOtherB-1115240976 tempest-ServerActionsTestOtherB-1115240976-project-member] Lock "e8860f63-c6ce-43ee-8c6e-6eea89d901d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.331s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:30:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.policy [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '797a8975406044ddabaad6e23950a71b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b2d179ed36d41038da75b63b1bde170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:30:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Creating image(s)
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk 1073741824" returned: 0 in 0.047s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Successfully created port: 1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Cannot resize image /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Successfully updated port: 1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquired lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-564bad10-acc0-4862-9967-d11cd171b9b5 req-32520a12-174e-411e-9790-ecd6d7d0cae4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-changed-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-564bad10-acc0-4862-9967-d11cd171b9b5 req-32520a12-174e-411e-9790-ecd6d7d0cae4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Refreshing instance network info cache due to event network-changed-1fc740fe-93b7-49bc-8136-86b411ec34c0. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-564bad10-acc0-4862-9967-d11cd171b9b5 req-32520a12-174e-411e-9790-ecd6d7d0cae4 service nova] Acquiring lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating instance_info_cache with network_info: [{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Releasing lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance network_info: |[{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-564bad10-acc0-4862-9967-d11cd171b9b5 req-32520a12-174e-411e-9790-ecd6d7d0cae4 service nova] Acquired lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-564bad10-acc0-4862-9967-d11cd171b9b5 req-32520a12-174e-411e-9790-ecd6d7d0cae4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Refreshing network info cache for port 1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Start _get_guest_xml network_info=[{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:30:42 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:30:42 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-32047452',display_name='tempest-ServerRescueNegativeTestJSON-server-32047452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-32047452',id=34,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4gqSavu/0+EshxWYO2Gl7WlMV6CsX979Tv3dWfmDW218WUXmQEX88lY8YM5vbXjzZ6oatayWjI3POVeLYOzNGGgyXX9jWgt3r1ix5SHG/ItK3E3AZfrZvKSFwpdm2UOA==',key_name='tempest-keypair-892943442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-40sm8ndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797a8975406044ddabaad6e23950a71b',uuid=6b291b73-1b23-415a-ae61-f994d6e33d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:05:65,bridge_name='br-int',has_traffic_filtering=True,id=1fc740fe-93b7-49bc-8136-86b411ec34c0,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc740fe-93') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:30:42 user nova-compute[75006]:   <uuid>6b291b73-1b23-415a-ae61-f994d6e33d7e</uuid>
Nov 27 03:30:42 user nova-compute[75006]:   <name>instance-00000022</name>
Nov 27 03:30:42 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:30:42 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:30:42 user nova-compute[75006]:   <metadata>
Nov 27 03:30:42 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:30:42 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:30:42 user nova-compute[75006]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-32047452</nova:name>
Nov 27 03:30:42 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:30:42</nova:creationTime>
Nov 27 03:30:42 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:30:42 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:30:42 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:30:42 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:30:42 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:30:42 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:30:42 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:30:42 user nova-compute[75006]:       <nova:owner>
Nov 27 03:30:42 user nova-compute[75006]:         <nova:user uuid="797a8975406044ddabaad6e23950a71b">tempest-ServerRescueNegativeTestJSON-599355303-project-member</nova:user>
Nov 27 03:30:42 user nova-compute[75006]:         <nova:project uuid="7b2d179ed36d41038da75b63b1bde170">tempest-ServerRescueNegativeTestJSON-599355303</nova:project>
Nov 27 03:30:42 user nova-compute[75006]:       </nova:owner>
Nov 27 03:30:42 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:30:42 user nova-compute[75006]:       <nova:ports>
Nov 27 03:30:42 user nova-compute[75006]:         <nova:port uuid="1fc740fe-93b7-49bc-8136-86b411ec34c0">
Nov 27 03:30:42 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 03:30:42 user nova-compute[75006]:         </nova:port>
Nov 27 03:30:42 user nova-compute[75006]:       </nova:ports>
Nov 27 03:30:42 user nova-compute[75006]:     </nova:instance>
Nov 27 03:30:42 user nova-compute[75006]:   </metadata>
Nov 27 03:30:42 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:30:42 user nova-compute[75006]:     <system>
Nov 27 03:30:42 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:30:42 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:30:42 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:30:42 user nova-compute[75006]:       <entry name="serial">6b291b73-1b23-415a-ae61-f994d6e33d7e</entry>
Nov 27 03:30:42 user nova-compute[75006]:       <entry name="uuid">6b291b73-1b23-415a-ae61-f994d6e33d7e</entry>
Nov 27 03:30:42 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:30:42 user nova-compute[75006]:     </system>
Nov 27 03:30:42 user nova-compute[75006]:   </sysinfo>
Nov 27 03:30:42 user nova-compute[75006]:   <os>
Nov 27 03:30:42 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:30:42 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:30:42 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:30:42 user nova-compute[75006]:   </os>
Nov 27 03:30:42 user nova-compute[75006]:   <features>
Nov 27 03:30:42 user nova-compute[75006]:     <acpi/>
Nov 27 03:30:42 user nova-compute[75006]:     <apic/>
Nov 27 03:30:42 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:30:42 user nova-compute[75006]:   </features>
Nov 27 03:30:42 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:30:42 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:30:42 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:30:42 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:30:42 user nova-compute[75006]:   </clock>
Nov 27 03:30:42 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:30:42 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:30:42 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:30:42 user nova-compute[75006]:   </cpu>
Nov 27 03:30:42 user nova-compute[75006]:   <devices>
Nov 27 03:30:42 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:30:42 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:30:42 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk"/>
Nov 27 03:30:42 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:30:42 user nova-compute[75006]:     </disk>
Nov 27 03:30:42 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:30:42 user nova-compute[75006]:       <mac address="fa:16:3e:64:05:65"/>
Nov 27 03:30:42 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:30:42 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:30:42 user nova-compute[75006]:       <target dev="tap1fc740fe-93"/>
Nov 27 03:30:42 user nova-compute[75006]:     </interface>
Nov 27 03:30:42 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:30:42 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/console.log" append="off"/>
Nov 27 03:30:42 user nova-compute[75006]:     </serial>
Nov 27 03:30:42 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:30:42 user nova-compute[75006]:     <video>
Nov 27 03:30:42 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:30:42 user nova-compute[75006]:     </video>
Nov 27 03:30:42 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:30:42 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:30:42 user nova-compute[75006]:     </rng>
Nov 27 03:30:42 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:30:42 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:30:42 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:30:42 user nova-compute[75006]:     </memballoon>
Nov 27 03:30:42 user nova-compute[75006]:   </devices>
Nov 27 03:30:42 user nova-compute[75006]: </domain>
Nov 27 03:30:42 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-32047452',display_name='tempest-ServerRescueNegativeTestJSON-server-32047452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-32047452',id=34,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4gqSavu/0+EshxWYO2Gl7WlMV6CsX979Tv3dWfmDW218WUXmQEX88lY8YM5vbXjzZ6oatayWjI3POVeLYOzNGGgyXX9jWgt3r1ix5SHG/ItK3E3AZfrZvKSFwpdm2UOA==',key_name='tempest-keypair-892943442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-40sm8ndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797a8975406044ddabaad6e23950a71b',uuid=6b291b73-1b23-415a-ae61-f994d6e33d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:05:65,bridge_name='br-int',has_traffic_filtering=True,id=1fc740fe-93b7-49bc-8136-86b411ec34c0,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc740fe-93') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG os_vif [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:05:65,bridge_name='br-int',has_traffic_filtering=True,id=1fc740fe-93b7-49bc-8136-86b411ec34c0,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc740fe-93') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40dd536b-10fe-55bc-b1e6-8cafad15e853', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fc740fe-93, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fc740fe-93, col_values=(('qos', UUID('bc74f0ce-9ef0-4bf4-8e7d-1ccbf5874328')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fc740fe-93, col_values=(('external_ids', {'iface-id': '1fc740fe-93b7-49bc-8136-86b411ec34c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:05:65', 'vm-uuid': '6b291b73-1b23-415a-ae61-f994d6e33d7e'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:42 user nova-compute[75006]: INFO os_vif [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:05:65,bridge_name='br-int',has_traffic_filtering=True,id=1fc740fe-93b7-49bc-8136-86b411ec34c0,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc740fe-93')
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No VIF found with MAC fa:16:3e:64:05:65, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:30:43 user nova-compute[75006]: DEBUG nova.network.neutron [req-564bad10-acc0-4862-9967-d11cd171b9b5 req-32520a12-174e-411e-9790-ecd6d7d0cae4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updated VIF entry in instance network info cache for port 1fc740fe-93b7-49bc-8136-86b411ec34c0. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:30:43 user nova-compute[75006]: DEBUG nova.network.neutron [req-564bad10-acc0-4862-9967-d11cd171b9b5 req-32520a12-174e-411e-9790-ecd6d7d0cae4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating instance_info_cache with network_info: [{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:30:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-564bad10-acc0-4862-9967-d11cd171b9b5 req-32520a12-174e-411e-9790-ecd6d7d0cae4 service nova] Releasing lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bULYnIBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:44 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3961d645-3a38-4c9f-a796-a38986ceb944]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:30:44 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e300eb1-ec2e-48f8-94fa-30b4038cf51a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71] added
Nov 27 03:30:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c697799-5212-4d42-8bef-f91917568e2b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c96151b-7065-4258-bc38-38ec117a2e01]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bULYnIBr {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bULYnIBr" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[641532c5-ddd0-4215-a5f9-0b7b13b47220]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bULYnIBr'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf09e95-f426-4c86-8d86-057670f9cf94]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af7949-76d7-4a28-9db1-f2e8f163d640]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --login" returned: 0 in 0.155s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b044048-ef12-488f-9439-b4a80469824d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71, portal: 172.16.0.220,3260]
Nov 27 03:30:44 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71, portal: 172.16.0.220,3260] successful.
Nov 27 03:30:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[149e706d-7111-4ef7-825b-bfece5a8f0c7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd54ca6-5f66-4dcb-a686-51c16ea8e44a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a9d95-f2b1-4fff-9fae-5984783166ec]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bULYnIBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-08624c8f-e523-4535-af7a-382b113d9fd5 req-79e30a0c-d3b8-4245-b928-f1fcce5d369c service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-08624c8f-e523-4535-af7a-382b113d9fd5 req-79e30a0c-d3b8-4245-b928-f1fcce5d369c service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-08624c8f-e523-4535-af7a-382b113d9fd5 req-79e30a0c-d3b8-4245-b928-f1fcce5d369c service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-08624c8f-e523-4535-af7a-382b113d9fd5 req-79e30a0c-d3b8-4245-b928-f1fcce5d369c service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-08624c8f-e523-4535-af7a-382b113d9fd5 req-79e30a0c-d3b8-4245-b928-f1fcce5d369c service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:44 user nova-compute[75006]: WARNING nova.compute.manager [req-08624c8f-e523-4535-af7a-382b113d9fd5 req-79e30a0c-d3b8-4245-b928-f1fcce5d369c service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state building and task_state spawning.
Nov 27 03:30:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26633313738353932', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633313738353932', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:30:45 user nova-compute[75006]: DEBUG nova.objects.instance [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:30:45 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:45 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:30:45 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:30:45 user nova-compute[75006]:   <serial>1c67425a-7562-4e78-a88d-2d1105dbec71</serial>
Nov 27 03:30:45 user nova-compute[75006]: </disk>
Nov 27 03:30:45 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:30:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No VIF found with MAC fa:16:3e:89:8b:a2, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d2dee215-904f-41b5-8a2b-203266297453 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.533s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:30:46 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance spawned successfully.
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:30:46 user nova-compute[75006]: INFO nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-17057019-132e-4db5-83e0-5ab0e373bd64 req-1efbd7c1-f555-4fad-ab36-05bd5100b36e service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-17057019-132e-4db5-83e0-5ab0e373bd64 req-1efbd7c1-f555-4fad-ab36-05bd5100b36e service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-17057019-132e-4db5-83e0-5ab0e373bd64 req-1efbd7c1-f555-4fad-ab36-05bd5100b36e service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-17057019-132e-4db5-83e0-5ab0e373bd64 req-1efbd7c1-f555-4fad-ab36-05bd5100b36e service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-17057019-132e-4db5-83e0-5ab0e373bd64 req-1efbd7c1-f555-4fad-ab36-05bd5100b36e service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:46 user nova-compute[75006]: WARNING nova.compute.manager [req-17057019-132e-4db5-83e0-5ab0e373bd64 req-1efbd7c1-f555-4fad-ab36-05bd5100b36e service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state building and task_state spawning.
Nov 27 03:30:46 user nova-compute[75006]: INFO nova.compute.manager [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Took 6.42 seconds to build instance.
Nov 27 03:30:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2d06cd3d-9a79-41e8-84a1-52162fc3f76b tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.521s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG nova.objects.instance [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:48 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa is timed out.
Nov 27 03:30:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Successfully detached device vdb from instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa from the live domain config.
Nov 27 03:30:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRAyDfbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:48 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3622a-8134-4763-99ac-1c799b08d309]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:30:48 user nova-compute[75006]: No targets found.
Nov 27 03:30:48 user nova-compute[75006]: iSNS:
Nov 27 03:30:48 user nova-compute[75006]: No targets found.
Nov 27 03:30:48 user nova-compute[75006]: STATIC:
Nov 27 03:30:48 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71
Nov 27 03:30:48 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:48 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:48 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:30:48 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:48 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:48 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1
Nov 27 03:30:48 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:48 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:48 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383
Nov 27 03:30:48 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:48 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:48 user nova-compute[75006]: FIRMWARE:
Nov 27 03:30:48 user nova-compute[75006]: No targets found.
Nov 27 03:30:48 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:30:48 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:30:48 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5218652f-b144-4a20-9bab-063aa2fbf329]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[51caf17d-646f-40d3-9677-def4f1b6cbe7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:48 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:48 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:48 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:48 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:48 user nova-compute[75006]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 (non-flash)
Nov 27 03:30:48 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:48 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:48 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4245892d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:30:48 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f6307-5b62-44aa-b0a3-268228e1e6c3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:49 user nova-compute[75006]: INFO nova.compute.manager [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Attaching volume d78fb93c-b9d6-4b5c-909f-3b5602d92d95 to /dev/vdc
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0731df0-b2d0-4e3e-a0a8-94bdce1d6be2]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afb64c4-e54d-4af4-b71e-bd99c98853fe]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.utils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[903bf8ab-9469-4f88-be5d-ff510912070d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1509972c-d2ed-4565-b8e9-2cd9138f1bbe]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[90246172-f840-436a-ac51-aa02c7d36cbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[96897093-7db1-4e91-9192-7f17814497e9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a8c4a-2b00-4a87-82fe-6cd8d4c86b12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ad2dd-80dd-4998-84ec-85c86a8f012a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:30:49 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5177179e-be0b-4338-9403-c48df8d13ed8]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.utils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Updating existing volume attachment record: 64b39af7-0cbc-4d1e-beb5-abb275ca6f23 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c221b6b-80b9-491d-a6ea-6be26f227b59]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1, portal: 172.16.0.220,3260]
Nov 27 03:30:49 user nova-compute[75006]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1, portal: 172.16.0.220,3260] successful.
Nov 27 03:30:49 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8b11b-ac53-4135-a33a-b918ee64124b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] <== disconnect_volume: return (375ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:30:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:50 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 20805ff8-bf32-4d64-8380-472195a9119a is timed out.
Nov 27 03:30:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully detached device vdb from instance 20805ff8-bf32-4d64-8380-472195a9119a from the live domain config.
Nov 27 03:30:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbICPBhO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:50 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2482c7e-cec6-45fc-87d1-dbedd8331ab8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:30:50 user nova-compute[75006]: No targets found.
Nov 27 03:30:50 user nova-compute[75006]: iSNS:
Nov 27 03:30:50 user nova-compute[75006]: No targets found.
Nov 27 03:30:50 user nova-compute[75006]: STATIC:
Nov 27 03:30:50 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71
Nov 27 03:30:50 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:50 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:50 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:30:50 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:50 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:50 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383
Nov 27 03:30:50 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:50 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:50 user nova-compute[75006]: FIRMWARE:
Nov 27 03:30:50 user nova-compute[75006]: No targets found.
Nov 27 03:30:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:30:50 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:30:50 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d57a172-7e14-4b68-839c-1e2ee2ced5ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0838231-1857-4be9-91ef-470bd7efae70]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:50 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:50 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:50 user nova-compute[75006]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 (non-flash)
Nov 27 03:30:50 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4244dac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d6e14e-a714-4d64-99d9-051a5759081c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[de79a71e-1941-480a-9bea-53c3cc22a4da]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[659c107e-a14b-4402-90c1-2fa28a490bfc]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf68ac06-1914-4b7d-8fbc-6cfcd7dc9821]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01edc91-426f-4d1d-8e2b-6ea2d77b3dd6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e579e9-84fb-4204-a983-7e24b5f089ef]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383, portal: 172.16.0.220,3260]
Nov 27 03:30:50 user nova-compute[75006]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383, portal: 172.16.0.220,3260] successful.
Nov 27 03:30:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bfa71c9-30fb-46c7-b4f6-032c5cff1383 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f0d507-06b0-4aca-be66-0c3cda947454]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] <== disconnect_volume: return (306ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:30:51 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'flavor' on Instance uuid 20805ff8-bf32-4d64-8380-472195a9119a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7859bfd4-959d-46c7-85e2-92d6bf3bdb1b tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.831s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:52 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:52 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:30:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:52 user nova-compute[75006]: DEBUG nova.objects.instance [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'flavor' on Instance uuid ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-79390b1b-6366-4acf-b0b6-cfa0a034dfb4 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.800s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 24.680s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:53 user nova-compute[75006]: INFO nova.compute.manager [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Terminating instance
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-7193e035-d978-4247-9978-98550ff94ef8 req-7fad9a2c-c518-4daf-9759-c42ca3549b69 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received event network-vif-unplugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7193e035-d978-4247-9978-98550ff94ef8 req-7fad9a2c-c518-4daf-9759-c42ca3549b69 service nova] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7193e035-d978-4247-9978-98550ff94ef8 req-7fad9a2c-c518-4daf-9759-c42ca3549b69 service nova] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7193e035-d978-4247-9978-98550ff94ef8 req-7fad9a2c-c518-4daf-9759-c42ca3549b69 service nova] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-7193e035-d978-4247-9978-98550ff94ef8 req-7fad9a2c-c518-4daf-9759-c42ca3549b69 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] No waiting events found dispatching network-vif-unplugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-7193e035-d978-4247-9978-98550ff94ef8 req-7fad9a2c-c518-4daf-9759-c42ca3549b69 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received event network-vif-unplugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Instance destroyed successfully.
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lazy-loading 'resources' on Instance uuid ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1374435848',display_name='tempest-VolumesSnapshotTestJSON-instance-1374435848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1374435848',id=29,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzo2j0woqrK7rdIUy+kI5sNZcCY+DoXCTv0LI7jrEbJ/uI8sAExI5c5M13Du3LN19LftEr5F99pEECmHK0hUnMLsiwm460SJfw7CDXMaWU2jmsprTkwh0szNCXGY/BOYA==',key_name='tempest-keypair-1428051761',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:28:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ada4ca9c11a4996ad5f00f6beac2398',ramdisk_id='',reservation_id='r-in2y43fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-59016333',owner_user_name='tempest-VolumesSnapshotTestJSON-59016333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:28:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b50c3d4e86ae40fbb9f38f2a88066a03',uuid=ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converting VIF {"id": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "address": "fa:16:3e:7f:77:55", "network": {"id": "d0f611d7-459e-4e0d-8dea-a740bd7097d8", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1377712007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ada4ca9c11a4996ad5f00f6beac2398", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ae897ca-6c", "ovs_interfaceid": "2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:77:55,bridge_name='br-int',has_traffic_filtering=True,id=2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae897ca-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_vif [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:77:55,bridge_name='br-int',has_traffic_filtering=True,id=2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae897ca-6c') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ae897ca-6c, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=102f3e50-e8d8-418b-9b3d-f51b0a6726b2) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:53 user nova-compute[75006]: INFO os_vif [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:77:55,bridge_name='br-int',has_traffic_filtering=True,id=2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713,network=Network(d0f611d7-459e-4e0d-8dea-a740bd7097d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ae897ca-6c')
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KRAyDfbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:53 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41ecb61-5086-47c4-876d-84d18f686171]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:30:53 user nova-compute[75006]: No targets found.
Nov 27 03:30:53 user nova-compute[75006]: iSNS:
Nov 27 03:30:53 user nova-compute[75006]: No targets found.
Nov 27 03:30:53 user nova-compute[75006]: STATIC:
Nov 27 03:30:53 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71
Nov 27 03:30:53 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:53 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:53 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:30:53 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:30:53 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:30:53 user nova-compute[75006]: FIRMWARE:
Nov 27 03:30:53 user nova-compute[75006]: No targets found.
Nov 27 03:30:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:30:53 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:30:53 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c083b5d-b3e0-44ea-a55a-8b8fcee637c1', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f83c9fa-3fd0-4550-bf8c-94592e861646]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4143603-902e-4d40-b0a3-9928dbbb4750]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:53 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:53 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e1b40>, {}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Disconnecting from: [] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] <== disconnect_volume: return (82ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:30:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Deleting instance files /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa_del
Nov 27 03:30:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Deletion of /opt/stack/data/nova/instances/ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa_del complete
Nov 27 03:30:54 user nova-compute[75006]: INFO nova.compute.manager [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 27 03:30:54 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updating instance_info_cache with network_info: [{"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:30:55 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Took 1.07 seconds to deallocate network for instance.
Nov 27 03:30:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-a3398c63-b7c9-447c-8776-c2d006a3e729 req-e9cff486-4b98-411d-b94a-dd5918ccd2f2 service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received event network-vif-deleted-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:55 user nova-compute[75006]: WARNING nova.volume.cinder [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Attachment 2bc19631-3907-4180-8845-462ee8443809 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2bc19631-3907-4180-8845-462ee8443809. (HTTP 404) (Request-ID: req-5f7655ba-00f2-4d6b-8669-646442f9c6da)
Nov 27 03:30:55 user nova-compute[75006]: INFO nova.compute.manager [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Took 0.05 seconds to detach 1 volumes for instance.
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-bf455995-40ee-4aa4-a618-35ed808efdc2 req-4a351aa4-68bc-46c2-82ac-adef0e8787dc service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received event network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bf455995-40ee-4aa4-a618-35ed808efdc2 req-4a351aa4-68bc-46c2-82ac-adef0e8787dc service nova] Acquiring lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bf455995-40ee-4aa4-a618-35ed808efdc2 req-4a351aa4-68bc-46c2-82ac-adef0e8787dc service nova] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bf455995-40ee-4aa4-a618-35ed808efdc2 req-4a351aa4-68bc-46c2-82ac-adef0e8787dc service nova] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-bf455995-40ee-4aa4-a618-35ed808efdc2 req-4a351aa4-68bc-46c2-82ac-adef0e8787dc service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] No waiting events found dispatching network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:30:55 user nova-compute[75006]: WARNING nova.compute.manager [req-bf455995-40ee-4aa4-a618-35ed808efdc2 req-4a351aa4-68bc-46c2-82ac-adef0e8787dc service nova] [instance: ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa] Received unexpected event network-vif-plugged-2ae897ca-6ce2-4bd7-8f5a-6ad7cf56a713 for instance with vm_state deleted and task_state None.
Nov 27 03:30:55 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:55 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Deleted allocations for instance ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c28d2eec-e1f8-420e-9499-9409d91963c6 tempest-VolumesSnapshotTestJSON-59016333 tempest-VolumesSnapshotTestJSON-59016333-project-member] Lock "ac4ee23f-e7ef-40ee-9e98-7d85a2b1d9aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.767s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNUKqvCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:30:56 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:56 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:30:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:30:56 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893d00d-f5aa-4af4-90d3-671ac850505e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:30:56 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[125a2806-3c18-4949-9c3d-2f17dc1ca210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95] added
Nov 27 03:30:56 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4f72b9-ba88-4770-a6b4-c13d421e93b8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ef6c5-583c-4857-abb7-4db558b64a01]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNUKqvCo {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZNUKqvCo" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c631b2a-fe4a-4c42-ab3d-a0d091bd6ec2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZNUKqvCo'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c862ce-e2ca-46c8-b7b2-a1a6e5d2edea]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aba8ba-c69c-4c7b-8f7e-f467176ddd04]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:57 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:57 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f424180-f207-4fc1-8657-b6167c02843f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95, portal: 172.16.0.220,3260]
Nov 27 03:30:57 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95, portal: 172.16.0.220,3260] successful.
Nov 27 03:30:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a344f2-04c0-4741-a34d-ee01017cd919]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acec793-3038-40dc-8aa2-ce1c936ed3c2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:57 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:57 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:30:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:30:57 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:30:57 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:30:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2936af75-b66f-43cb-bf7d-b5400cbdcd05]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNUKqvCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23465346338313766', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465346338313766', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:30:58 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:30:58 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:30:58 user nova-compute[75006]:   <target dev="vdc" bus="virtio"/>
Nov 27 03:30:58 user nova-compute[75006]:   <serial>d78fb93c-b9d6-4b5c-909f-3b5602d92d95</serial>
Nov 27 03:30:58 user nova-compute[75006]: </disk>
Nov 27 03:30:58 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] No VIF found with MAC fa:16:3e:89:8b:a2, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63618c35-8a06-4c20-8d68-f09cae9474d1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.307s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:30:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:31:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7431MB free_disk=25.23772430419922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 20805ff8-bf32-4d64-8380-472195a9119a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6990b476-cfd5-43c0-a295-5ee42393d35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6b291b73-1b23-415a-ae61-f994d6e33d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:00 user nova-compute[75006]: INFO nova.compute.manager [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Detaching volume 1c67425a-7562-4e78-a88d-2d1105dbec71
Nov 27 03:31:00 user nova-compute[75006]: INFO nova.virt.block_device [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Attempting to driver detach volume 1c67425a-7562-4e78-a88d-2d1105dbec71 from mountpoint /dev/vdb
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Attempting to detach device vdb from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:31:00 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:00 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:31:00 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:31:00 user nova-compute[75006]:   <serial>1c67425a-7562-4e78-a88d-2d1105dbec71</serial>
Nov 27 03:31:00 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:31:00 user nova-compute[75006]: </disk>
Nov 27 03:31:00 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:31:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully detached device vdb from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 from the persistent domain config.
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:31:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:31:00 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:00 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:31:00 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:31:00 user nova-compute[75006]:   <serial>1c67425a-7562-4e78-a88d-2d1105dbec71</serial>
Nov 27 03:31:00 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:31:00 user nova-compute[75006]: </disk>
Nov 27 03:31:00 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:31:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-a277fed6-6057-4c52-b38f-97c239b851f0 req-76f1a927-f967-4e82-9069-98b8a2282c42 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-changed-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-a277fed6-6057-4c52-b38f-97c239b851f0 req-76f1a927-f967-4e82-9069-98b8a2282c42 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Refreshing instance network info cache due to event network-changed-c1ecf59a-5a42-4cfb-be41-dc5182153ce5. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a277fed6-6057-4c52-b38f-97c239b851f0 req-76f1a927-f967-4e82-9069-98b8a2282c42 service nova] Acquiring lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a277fed6-6057-4c52-b38f-97c239b851f0 req-76f1a927-f967-4e82-9069-98b8a2282c42 service nova] Acquired lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-a277fed6-6057-4c52-b38f-97c239b851f0 req-76f1a927-f967-4e82-9069-98b8a2282c42 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Refreshing network info cache for port c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-a277fed6-6057-4c52-b38f-97c239b851f0 req-76f1a927-f967-4e82-9069-98b8a2282c42 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updated VIF entry in instance network info cache for port c1ecf59a-5a42-4cfb-be41-dc5182153ce5. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-a277fed6-6057-4c52-b38f-97c239b851f0 req-76f1a927-f967-4e82-9069-98b8a2282c42 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updating instance_info_cache with network_info: [{"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a277fed6-6057-4c52-b38f-97c239b851f0 req-76f1a927-f967-4e82-9069-98b8a2282c42 service nova] Releasing lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG nova.objects.instance [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'flavor' on Instance uuid 6990b476-cfd5-43c0-a295-5ee42393d35b {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:03 user nova-compute[75006]: INFO nova.compute.manager [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Attaching volume e42a8eba-6c44-49dd-995b-4ca4ee754ba8 to /dev/vdb
Nov 27 03:31:03 user nova-compute[75006]: DEBUG os_brick.utils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b43a9e-9be7-48bb-a5b0-4c49310155b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a2a119-fb11-4f14-982f-48ddd969bd9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c5b458-8138-4e11-b20f-106293bdc93e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d889ba-6ab2-4e38-a148-a01d673778d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:31:03 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:31:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f9ed80-e3d8-42aa-8071-affb4b32ee6b]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG os_brick.utils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:03 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updating existing volume attachment record: 567d4b89-9ed3-46ea-b14b-b89c73b8607e {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:31:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vODUulLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:09 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b15eb-b934-40ee-876c-411ba65c22cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:31:09 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a52f33-f201-4f97-b994-a5c428451dab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8] added
Nov 27 03:31:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e754ab-8a97-48fd-994c-04fbb39b8ed7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b5885-6de2-4102-9b2c-dd3d02720425]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vODUulLw {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vODUulLw" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c99b4cd-4d8b-4b12-abc6-984a407079d8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vODUulLw'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de5737f-b4d3-468c-97b9-b8f4393ce3db]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[387df284-4bb3-453d-a5e7-e755b3adf570]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85422d1-67d5-4074-a47f-af04a2cda1fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8, portal: 172.16.0.220,3260]
Nov 27 03:31:10 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8, portal: 172.16.0.220,3260] successful.
Nov 27 03:31:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570450e-e8af-43af-ac5c-b6ffa2f8ef9a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b2682-ff4b-4c0f-850b-fd120e03fd44]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed20b61d-e0cb-4978-9428-203a8050ab57]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vODUulLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23434346163636136', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434346163636136', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG nova.objects.instance [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'flavor' on Instance uuid 6990b476-cfd5-43c0-a295-5ee42393d35b {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:31:11 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:11 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:31:11 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:31:11 user nova-compute[75006]:   <serial>e42a8eba-6c44-49dd-995b-4ca4ee754ba8</serial>
Nov 27 03:31:11 user nova-compute[75006]: </disk>
Nov 27 03:31:11 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No VIF found with MAC fa:16:3e:3c:99:fd, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:31:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-2bc0fd7b-b2f4-4e81-bfde-447fc0bf8543 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.066s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-a64932d9-129c-48e9-afec-dd459109e462 req-ea08082c-6085-44f2-8914-1dbff09d90b5 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-changed-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-a64932d9-129c-48e9-afec-dd459109e462 req-ea08082c-6085-44f2-8914-1dbff09d90b5 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Refreshing instance network info cache due to event network-changed-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:31:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a64932d9-129c-48e9-afec-dd459109e462 req-ea08082c-6085-44f2-8914-1dbff09d90b5 service nova] Acquiring lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:31:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a64932d9-129c-48e9-afec-dd459109e462 req-ea08082c-6085-44f2-8914-1dbff09d90b5 service nova] Acquired lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:31:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-a64932d9-129c-48e9-afec-dd459109e462 req-ea08082c-6085-44f2-8914-1dbff09d90b5 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Refreshing network info cache for port 424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:31:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-a64932d9-129c-48e9-afec-dd459109e462 req-ea08082c-6085-44f2-8914-1dbff09d90b5 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updated VIF entry in instance network info cache for port 424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:31:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-a64932d9-129c-48e9-afec-dd459109e462 req-ea08082c-6085-44f2-8914-1dbff09d90b5 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updating instance_info_cache with network_info: [{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a64932d9-129c-48e9-afec-dd459109e462 req-ea08082c-6085-44f2-8914-1dbff09d90b5 service nova] Releasing lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:31:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:13 user nova-compute[75006]: INFO nova.compute.manager [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Detaching volume e42a8eba-6c44-49dd-995b-4ca4ee754ba8
Nov 27 03:31:13 user nova-compute[75006]: INFO nova.virt.block_device [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Attempting to driver detach volume e42a8eba-6c44-49dd-995b-4ca4ee754ba8 from mountpoint /dev/vdb
Nov 27 03:31:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Attempting to detach device vdb from instance 6990b476-cfd5-43c0-a295-5ee42393d35b from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:31:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:31:14 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:14 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:31:14 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:31:14 user nova-compute[75006]:   <serial>e42a8eba-6c44-49dd-995b-4ca4ee754ba8</serial>
Nov 27 03:31:14 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:31:14 user nova-compute[75006]: </disk>
Nov 27 03:31:14 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:31:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Successfully detached device vdb from instance 6990b476-cfd5-43c0-a295-5ee42393d35b from the persistent domain config.
Nov 27 03:31:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6990b476-cfd5-43c0-a295-5ee42393d35b from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:31:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:31:14 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:14 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:31:14 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:31:14 user nova-compute[75006]:   <serial>e42a8eba-6c44-49dd-995b-4ca4ee754ba8</serial>
Nov 27 03:31:14 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:31:14 user nova-compute[75006]: </disk>
Nov 27 03:31:14 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:31:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6990b476-cfd5-43c0-a295-5ee42393d35b {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:31:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:19 user nova-compute[75006]: INFO nova.compute.manager [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Terminating instance
Nov 27 03:31:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-ec5f0b30-4376-455c-ba0c-0c61d776ee7b req-424420e7-c46e-4fbf-b9f0-81dfc929b517 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received event network-vif-unplugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ec5f0b30-4376-455c-ba0c-0c61d776ee7b req-424420e7-c46e-4fbf-b9f0-81dfc929b517 service nova] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ec5f0b30-4376-455c-ba0c-0c61d776ee7b req-424420e7-c46e-4fbf-b9f0-81dfc929b517 service nova] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ec5f0b30-4376-455c-ba0c-0c61d776ee7b req-424420e7-c46e-4fbf-b9f0-81dfc929b517 service nova] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-ec5f0b30-4376-455c-ba0c-0c61d776ee7b req-424420e7-c46e-4fbf-b9f0-81dfc929b517 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] No waiting events found dispatching network-vif-unplugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG nova.compute.manager [req-ec5f0b30-4376-455c-ba0c-0c61d776ee7b req-424420e7-c46e-4fbf-b9f0-81dfc929b517 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received event network-vif-unplugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Instance destroyed successfully.
Nov 27 03:31:20 user nova-compute[75006]: DEBUG nova.objects.instance [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lazy-loading 'resources' on Instance uuid 20805ff8-bf32-4d64-8380-472195a9119a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-542504561',display_name='tempest-AttachVolumeNegativeTest-server-542504561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-542504561',id=30,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIc6T4sYGevzofw/2EW0ULAn1CY3IrPocfu+vQJnsTLSnNhQM9Ndd5R5miYPRWMxunOowVhYQ2+MECiN0sdqRzbXF89T2h5gXpVPoapuKEjngJTxQMuixYsazC1U5ApTw==',key_name='tempest-keypair-1183071301',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f30af4989ad4414083de0576cf4dbd48',ramdisk_id='',reservation_id='r-zu176z00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-66969864',owner_user_name='tempest-AttachVolumeNegativeTest-66969864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1836d0da810f4525addd0b02ae57c617',uuid=20805ff8-bf32-4d64-8380-472195a9119a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converting VIF {"id": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "address": "fa:16:3e:d1:bb:d8", "network": {"id": "c4ed9ac6-1edf-47a6-9125-65157c7d3d6c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808956697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f30af4989ad4414083de0576cf4dbd48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d2ca5e-f4", "ovs_interfaceid": "87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bb:d8,bridge_name='br-int',has_traffic_filtering=True,id=87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d2ca5e-f4') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG os_vif [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bb:d8,bridge_name='br-int',has_traffic_filtering=True,id=87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d2ca5e-f4') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87d2ca5e-f4, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1affd52-820b-46e0-b907-f940962978d6) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:20 user nova-compute[75006]: INFO os_vif [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:bb:d8,bridge_name='br-int',has_traffic_filtering=True,id=87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff,network=Network(c4ed9ac6-1edf-47a6-9125-65157c7d3d6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d2ca5e-f4')
Nov 27 03:31:20 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Deleting instance files /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a_del
Nov 27 03:31:20 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Deletion of /opt/stack/data/nova/instances/20805ff8-bf32-4d64-8380-472195a9119a_del complete
Nov 27 03:31:21 user nova-compute[75006]: INFO nova.compute.manager [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:31:21 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 is timed out.
Nov 27 03:31:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully detached device vdb from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 from the live domain config.
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bULYnIBr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:21 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:21 user nova-compute[75006]: INFO nova.compute.manager [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Unshelving
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd966c50-6152-4ba3-b8ff-6d9eb3139b10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:31:21 user nova-compute[75006]: No targets found.
Nov 27 03:31:21 user nova-compute[75006]: iSNS:
Nov 27 03:31:21 user nova-compute[75006]: No targets found.
Nov 27 03:31:21 user nova-compute[75006]: STATIC:
Nov 27 03:31:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95
Nov 27 03:31:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8
Nov 27 03:31:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71
Nov 27 03:31:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:21 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:31:21 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:21 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:21 user nova-compute[75006]: FIRMWARE:
Nov 27 03:31:21 user nova-compute[75006]: No targets found.
Nov 27 03:31:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:31:21 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:31:21 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5bd73c-ccea-47b8-af3f-fd31ed1cf928]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed6acad-03b2-4b1c-be66-3b31898a8266]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:21 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:31:21 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:21 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:21 user nova-compute[75006]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 (non-flash)
Nov 27 03:31:21 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:21 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd42473f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: INFO nova.virt.block_device [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Booting with volume 2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 at /dev/vda
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe74889-d838-43a5-b820-0be63e6f5d28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e319a1f-6c00-4a4b-8343-e839951f81c6]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d85cf-f6af-4c30-81da-b62f54d43e95]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.utils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ecfd1c-fbf6-4433-8f27-2e69cb87e4ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d8d185-c709-485c-9c85-93dd947d42d9]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb74e46-7f22-422c-b610-281d2666e943]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de9ae82-250c-4327-b952-66fa39ffa520]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59517ad-0d39-414c-818e-f8ced02937c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cb4bec-7418-4740-89e4-47bdc7477de3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9253475a-e437-49d9-947c-f7dab23c244c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71, portal: 172.16.0.220,3260]
Nov 27 03:31:21 user nova-compute[75006]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71, portal: 172.16.0.220,3260] successful.
Nov 27 03:31:21 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:31:21 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d839cc-0b0c-4e41-9001-d4b36d565991]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.utils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating existing volume attachment record: a0999b12-535f-49bd-873b-f3400d4c122d {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:31:21 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Took 0.72 seconds to deallocate network for instance.
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-200cf124-ff84-4cc2-91f9-ad27ae0be9c9 req-ca72b495-0637-4f95-8eb4-6ebcde0297ab service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received event network-vif-deleted-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:21 user nova-compute[75006]: INFO nova.compute.manager [req-200cf124-ff84-4cc2-91f9-ad27ae0be9c9 req-ca72b495-0637-4f95-8eb4-6ebcde0297ab service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Neutron deleted interface 87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff; detaching it from the instance and deleting it from the info cache
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.network.neutron [req-200cf124-ff84-4cc2-91f9-ad27ae0be9c9 req-ca72b495-0637-4f95-8eb4-6ebcde0297ab service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c67425a-7562-4e78-a88d-2d1105dbec71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[325b1c42-9bb7-498e-8d62-13b847a44273]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== disconnect_volume: return (374ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-200cf124-ff84-4cc2-91f9-ad27ae0be9c9 req-ca72b495-0637-4f95-8eb4-6ebcde0297ab service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Detach interface failed, port_id=87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff, reason: Instance 20805ff8-bf32-4d64-8380-472195a9119a could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:22 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Deleted allocations for instance 20805ff8-bf32-4d64-8380-472195a9119a
Nov 27 03:31:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-12a03830-52d5-4ba0-90d6-f55ff7d55bee tempest-AttachVolumeNegativeTest-66969864 tempest-AttachVolumeNegativeTest-66969864-project-member] Lock "20805ff8-bf32-4d64-8380-472195a9119a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.352s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-13b51688-a22f-42c3-8e3c-1f55b8be7e63 req-1e4cf7c9-7d00-4ced-bd53-7ec36df08a00 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received event network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-13b51688-a22f-42c3-8e3c-1f55b8be7e63 req-1e4cf7c9-7d00-4ced-bd53-7ec36df08a00 service nova] Acquiring lock "20805ff8-bf32-4d64-8380-472195a9119a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-13b51688-a22f-42c3-8e3c-1f55b8be7e63 req-1e4cf7c9-7d00-4ced-bd53-7ec36df08a00 service nova] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-13b51688-a22f-42c3-8e3c-1f55b8be7e63 req-1e4cf7c9-7d00-4ced-bd53-7ec36df08a00 service nova] Lock "20805ff8-bf32-4d64-8380-472195a9119a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-13b51688-a22f-42c3-8e3c-1f55b8be7e63 req-1e4cf7c9-7d00-4ced-bd53-7ec36df08a00 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] No waiting events found dispatching network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:22 user nova-compute[75006]: WARNING nova.compute.manager [req-13b51688-a22f-42c3-8e3c-1f55b8be7e63 req-1e4cf7c9-7d00-4ced-bd53-7ec36df08a00 service nova] [instance: 20805ff8-bf32-4d64-8380-472195a9119a] Received unexpected event network-vif-plugged-87d2ca5e-f4d5-4baa-af43-f9e74f63a7ff for instance with vm_state deleted and task_state None.
Nov 27 03:31:22 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8793e478-0f0c-4361-9239-5e24ed5b6ccf tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.857s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:23 user nova-compute[75006]: INFO nova.compute.manager [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Detaching volume d78fb93c-b9d6-4b5c-909f-3b5602d92d95
Nov 27 03:31:23 user nova-compute[75006]: INFO nova.virt.block_device [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Attempting to driver detach volume d78fb93c-b9d6-4b5c-909f-3b5602d92d95 from mountpoint /dev/vdc
Nov 27 03:31:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Attempting to detach device vdc from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:31:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:31:23 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:23 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:31:23 user nova-compute[75006]:   <target dev="vdc" bus="virtio"/>
Nov 27 03:31:23 user nova-compute[75006]:   <serial>d78fb93c-b9d6-4b5c-909f-3b5602d92d95</serial>
Nov 27 03:31:23 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 03:31:23 user nova-compute[75006]: </disk>
Nov 27 03:31:23 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:31:23 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully detached device vdc from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 from the persistent domain config.
Nov 27 03:31:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:31:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:31:23 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:23 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:31:23 user nova-compute[75006]:   <target dev="vdc" bus="virtio"/>
Nov 27 03:31:23 user nova-compute[75006]:   <serial>d78fb93c-b9d6-4b5c-909f-3b5602d92d95</serial>
Nov 27 03:31:23 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 03:31:23 user nova-compute[75006]: </disk>
Nov 27 03:31:23 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:31:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:31:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:28 user nova-compute[75006]: DEBUG nova.objects.instance [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lazy-loading 'pci_requests' on Instance uuid 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:28 user nova-compute[75006]: DEBUG nova.objects.instance [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lazy-loading 'numa_topology' on Instance uuid 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:28 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:31:28 user nova-compute[75006]: INFO nova.compute.claims [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Claim successful on node user
Nov 27 03:31:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:28 user nova-compute[75006]: INFO nova.compute.manager [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Unshelving
Nov 27 03:31:29 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:31:29 user nova-compute[75006]: INFO nova.virt.block_device [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Booting with volume 11dbf17c-a923-4485-983e-6636832a244c at /dev/vdc
Nov 27 03:31:29 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG os_brick.utils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3623f3af-3856-4ff1-bdc0-2d9df574126a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d033f8-7a0c-48a2-a9d8-28b7a2b6acd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcfc469-b51a-41ec-9d12-f42caa7cac4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c63e6fd-696a-497d-b93b-9e068a32c8fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:29 user nova-compute[75006]: INFO nova.network.neutron [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating port e5137b18-6b9a-4ee0-af15-45581ed243c2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:31:29 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3fbe37-6213-4f45-8937-961ff859ffb5]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG os_brick.utils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating existing volume attachment record: 448a8639-9d88-4a62-994f-e466797f50f6 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquired lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:31:29 user nova-compute[75006]: DEBUG nova.network.neutron [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-509008d5-d885-4ab4-b6ef-bea651d251e5 req-909d4760-89ba-4246-b5f7-086940fe2b9e service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-509008d5-d885-4ab4-b6ef-bea651d251e5 req-909d4760-89ba-4246-b5f7-086940fe2b9e service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing instance network info cache due to event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-509008d5-d885-4ab4-b6ef-bea651d251e5 req-909d4760-89ba-4246-b5f7-086940fe2b9e service nova] Acquiring lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.network.neutron [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Releasing lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:31:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Creating image(s)
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Ensure instance console log exists: /opt/stack/data/nova/instances/67512cf7-e06d-406e-ad8b-fcfd6fbbb472/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Start _get_guest_xml network_info=[{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'a0999b12-535f-49bd-873b-f3400d4c122d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJijpCdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67512cf7-e06d-406e-ad8b-fcfd6fbbb472', 'attached_at': '', 'detached_at': '', 'volume_id': '2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'serial': '2ae6deb1-eb3e-4ecf-81d6-86c36412cee0'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-509008d5-d885-4ab4-b6ef-bea651d251e5 req-909d4760-89ba-4246-b5f7-086940fe2b9e service nova] Acquired lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.network.neutron [req-509008d5-d885-4ab4-b6ef-bea651d251e5 req-909d4760-89ba-4246-b5f7-086940fe2b9e service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:31:30 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:31:30 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.objects.instance [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.objects.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Object Instance<67512cf7-e06d-406e-ad8b-fcfd6fbbb472> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJijpCdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:30 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:30 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:30 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b702ab-625c-48d2-a7bc-e012855e3e76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:31:30 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[64037404-c190-4efb-886a-3559db730e99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0] added
Nov 27 03:31:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbe59d8-3491-41c7-85c1-a4dd85adcbe3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[891d2687-2d6c-463a-9154-b710c8596326]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJijpCdg {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJijpCdg" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85894f7-0a3f-4146-8a6b-69436d5136c0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJijpCdg'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dafb46e-0b88-405f-9df7-39b2befdacfa]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a8fd3b-d58b-49a9-adf2-5b81227f934c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:30 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:30 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:30 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:30 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92f701f-db35-48b5-9304-722471ee9d1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260]
Nov 27 03:31:30 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260] successful.
Nov 27 03:31:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dad5bbd-e998-4553-87f7-f2c965963f7f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d6cbf-9c01-4efd-b6f8-ee28fe2a2a00]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:31 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:31 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:31 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:31 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:31 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:31 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:31 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f56e85-9eba-4dca-980f-0fe85ac09321]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJijpCdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-509008d5-d885-4ab4-b6ef-bea651d251e5 req-909d4760-89ba-4246-b5f7-086940fe2b9e service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updated VIF entry in instance network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-509008d5-d885-4ab4-b6ef-bea651d251e5 req-909d4760-89ba-4246-b5f7-086940fe2b9e service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-509008d5-d885-4ab4-b6ef-bea651d251e5 req-909d4760-89ba-4246-b5f7-086940fe2b9e service nova] Releasing lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23962346135393162', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962346135393162', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1350526478',display_name='tempest-TestShelveInstance-server-1350526478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1350526478',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-800573928',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c4cdd7f6a9244a1d825cda5b92610432',ramdisk_id='',reservation_id='r-oh2aae0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-313467041',owner_user_name='tempest-TestShelveInstance-313467041-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:31:22Z,user_data=None,user_id='24fcf1d84af04fa09278a318510fe6fd',uuid=67512cf7-e06d-406e-ad8b-fcfd6fbbb472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converting VIF {"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.objects.instance [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lazy-loading 'pci_devices' on Instance uuid 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.objects.base [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Object Instance<67512cf7-e06d-406e-ad8b-fcfd6fbbb472> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:31:32 user nova-compute[75006]:   <uuid>67512cf7-e06d-406e-ad8b-fcfd6fbbb472</uuid>
Nov 27 03:31:32 user nova-compute[75006]:   <name>instance-0000001a</name>
Nov 27 03:31:32 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:31:32 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:31:32 user nova-compute[75006]:   <metadata>
Nov 27 03:31:32 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:31:32 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:31:32 user nova-compute[75006]:       <nova:name>tempest-TestShelveInstance-server-1350526478</nova:name>
Nov 27 03:31:32 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:31:30</nova:creationTime>
Nov 27 03:31:32 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:31:32 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:31:32 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:31:32 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:31:32 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:31:32 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:31:32 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:31:32 user nova-compute[75006]:       <nova:owner>
Nov 27 03:31:32 user nova-compute[75006]:         <nova:user uuid="24fcf1d84af04fa09278a318510fe6fd">tempest-TestShelveInstance-313467041-project-member</nova:user>
Nov 27 03:31:32 user nova-compute[75006]:         <nova:project uuid="c4cdd7f6a9244a1d825cda5b92610432">tempest-TestShelveInstance-313467041</nova:project>
Nov 27 03:31:32 user nova-compute[75006]:       </nova:owner>
Nov 27 03:31:32 user nova-compute[75006]:       <nova:ports>
Nov 27 03:31:32 user nova-compute[75006]:         <nova:port uuid="e5137b18-6b9a-4ee0-af15-45581ed243c2">
Nov 27 03:31:32 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:31:32 user nova-compute[75006]:         </nova:port>
Nov 27 03:31:32 user nova-compute[75006]:       </nova:ports>
Nov 27 03:31:32 user nova-compute[75006]:     </nova:instance>
Nov 27 03:31:32 user nova-compute[75006]:   </metadata>
Nov 27 03:31:32 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:31:32 user nova-compute[75006]:     <system>
Nov 27 03:31:32 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:31:32 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:31:32 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:31:32 user nova-compute[75006]:       <entry name="serial">67512cf7-e06d-406e-ad8b-fcfd6fbbb472</entry>
Nov 27 03:31:32 user nova-compute[75006]:       <entry name="uuid">67512cf7-e06d-406e-ad8b-fcfd6fbbb472</entry>
Nov 27 03:31:32 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:31:32 user nova-compute[75006]:     </system>
Nov 27 03:31:32 user nova-compute[75006]:   </sysinfo>
Nov 27 03:31:32 user nova-compute[75006]:   <os>
Nov 27 03:31:32 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:31:32 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:31:32 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:31:32 user nova-compute[75006]:   </os>
Nov 27 03:31:32 user nova-compute[75006]:   <features>
Nov 27 03:31:32 user nova-compute[75006]:     <acpi/>
Nov 27 03:31:32 user nova-compute[75006]:     <apic/>
Nov 27 03:31:32 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:31:32 user nova-compute[75006]:   </features>
Nov 27 03:31:32 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:31:32 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:31:32 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:31:32 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:31:32 user nova-compute[75006]:   </clock>
Nov 27 03:31:32 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:31:32 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:31:32 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:31:32 user nova-compute[75006]:   </cpu>
Nov 27 03:31:32 user nova-compute[75006]:   <devices>
Nov 27 03:31:32 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:31:32 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:32 user nova-compute[75006]:       <source dev="/dev/sdd"/>
Nov 27 03:31:32 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:31:32 user nova-compute[75006]:       <serial>2ae6deb1-eb3e-4ecf-81d6-86c36412cee0</serial>
Nov 27 03:31:32 user nova-compute[75006]:     </disk>
Nov 27 03:31:32 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:31:32 user nova-compute[75006]:       <mac address="fa:16:3e:4c:d6:07"/>
Nov 27 03:31:32 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:31:32 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:31:32 user nova-compute[75006]:       <target dev="tape5137b18-6b"/>
Nov 27 03:31:32 user nova-compute[75006]:     </interface>
Nov 27 03:31:32 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:31:32 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/67512cf7-e06d-406e-ad8b-fcfd6fbbb472/console.log" append="off"/>
Nov 27 03:31:32 user nova-compute[75006]:     </serial>
Nov 27 03:31:32 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:31:32 user nova-compute[75006]:     <video>
Nov 27 03:31:32 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:31:32 user nova-compute[75006]:     </video>
Nov 27 03:31:32 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:31:32 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:31:32 user nova-compute[75006]:     </rng>
Nov 27 03:31:32 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:31:32 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:31:32 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:31:32 user nova-compute[75006]:     </memballoon>
Nov 27 03:31:32 user nova-compute[75006]:   </devices>
Nov 27 03:31:32 user nova-compute[75006]: </domain>
Nov 27 03:31:32 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1350526478',display_name='tempest-TestShelveInstance-server-1350526478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1350526478',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-800573928',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c4cdd7f6a9244a1d825cda5b92610432',ramdisk_id='',reservation_id='r-oh2aae0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-313467041',owner_user_name='tempest-TestShelveInstance-313467041-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:31:22Z,user_data=None,user_id='24fcf1d84af04fa09278a318510fe6fd',uuid=67512cf7-e06d-406e-ad8b-fcfd6fbbb472,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converting VIF {"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG os_vif [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26684faf-f3a8-508b-a0e9-3b1cfdedf3ed', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5137b18-6b, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5137b18-6b, col_values=(('qos', UUID('70cfe125-9d8c-4c87-b5aa-c102cb11bef6')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5137b18-6b, col_values=(('external_ids', {'iface-id': 'e5137b18-6b9a-4ee0-af15-45581ed243c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:d6:07', 'vm-uuid': '67512cf7-e06d-406e-ad8b-fcfd6fbbb472'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:32 user nova-compute[75006]: INFO os_vif [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b')
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:31:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] No VIF found with MAC fa:16:3e:4c:d6:07, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:31:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-fbc738e5-cdf7-4af6-8ae3-dca456c44b7b req-4d47d5d6-4950-460f-8c83-52616b90b623 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fbc738e5-cdf7-4af6-8ae3-dca456c44b7b req-4d47d5d6-4950-460f-8c83-52616b90b623 service nova] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fbc738e5-cdf7-4af6-8ae3-dca456c44b7b req-4d47d5d6-4950-460f-8c83-52616b90b623 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fbc738e5-cdf7-4af6-8ae3-dca456c44b7b req-4d47d5d6-4950-460f-8c83-52616b90b623 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-fbc738e5-cdf7-4af6-8ae3-dca456c44b7b req-4d47d5d6-4950-460f-8c83-52616b90b623 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] No waiting events found dispatching network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:33 user nova-compute[75006]: WARNING nova.compute.manager [req-fbc738e5-cdf7-4af6-8ae3-dca456c44b7b req-4d47d5d6-4950-460f-8c83-52616b90b623 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received unexpected event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 03:31:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:34 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6990b476-cfd5-43c0-a295-5ee42393d35b is timed out.
Nov 27 03:31:34 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Successfully detached device vdb from instance 6990b476-cfd5-43c0-a295-5ee42393d35b from the live domain config.
Nov 27 03:31:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vODUulLw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:34 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[625aa64e-5dbc-4b60-a18c-fbb7d830a472]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:31:34 user nova-compute[75006]: No targets found.
Nov 27 03:31:34 user nova-compute[75006]: iSNS:
Nov 27 03:31:34 user nova-compute[75006]: No targets found.
Nov 27 03:31:34 user nova-compute[75006]: STATIC:
Nov 27 03:31:34 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95
Nov 27 03:31:34 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:34 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:34 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8
Nov 27 03:31:34 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:34 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:34 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:31:34 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:34 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:34 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0
Nov 27 03:31:34 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:34 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:34 user nova-compute[75006]: FIRMWARE:
Nov 27 03:31:34 user nova-compute[75006]: No targets found.
Nov 27 03:31:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:31:34 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:31:34 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dbfd26-135b-43c4-a158-fc4d7fe057c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8216b2-e7db-4fd0-a569-97aabe8ea416]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:34 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:34 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:34 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:34 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:34 user nova-compute[75006]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 (non-flash)
Nov 27 03:31:34 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd42473c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f3266-5493-44c7-b0c1-f53b2682773f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac6c16-302a-4517-8a48-04faa1b60f24]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dc0d1d-1666-4f86-8431-031be4b97707]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db651c7-3589-4c70-9d1b-3e5b62b945e4]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[09207f1e-2995-4e72-bfa3-f7c691e74e3d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e95227-01e6-4828-a358-bce56cd3c8a6]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8, portal: 172.16.0.220,3260]
Nov 27 03:31:34 user nova-compute[75006]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8, portal: 172.16.0.220,3260] successful.
Nov 27 03:31:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42a8eba-6c44-49dd-995b-4ca4ee754ba8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1efbb15-81c6-4acf-9f40-8345503143cf]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] <== disconnect_volume: return (343ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG nova.compute.manager [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:31:35 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance spawned successfully.
Nov 27 03:31:35 user nova-compute[75006]: DEBUG nova.compute.manager [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG nova.objects.instance [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'flavor' on Instance uuid 6990b476-cfd5-43c0-a295-5ee42393d35b {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-188c0ca3-1295-48dd-ad6f-d0724de0f954 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.249s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d121887d-1083-47b7-8a22-b958caf497c7 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.787s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-25a96816-36bc-47f4-abdd-908f71047755 req-3d983fb8-4a5c-4928-8872-49c438a07e13 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-25a96816-36bc-47f4-abdd-908f71047755 req-3d983fb8-4a5c-4928-8872-49c438a07e13 service nova] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-25a96816-36bc-47f4-abdd-908f71047755 req-3d983fb8-4a5c-4928-8872-49c438a07e13 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-25a96816-36bc-47f4-abdd-908f71047755 req-3d983fb8-4a5c-4928-8872-49c438a07e13 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-25a96816-36bc-47f4-abdd-908f71047755 req-3d983fb8-4a5c-4928-8872-49c438a07e13 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] No waiting events found dispatching network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:35 user nova-compute[75006]: WARNING nova.compute.manager [req-25a96816-36bc-47f4-abdd-908f71047755 req-3d983fb8-4a5c-4928-8872-49c438a07e13 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received unexpected event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 for instance with vm_state active and task_state None.
Nov 27 03:31:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:36 user nova-compute[75006]: DEBUG nova.objects.instance [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'pci_requests' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:36 user nova-compute[75006]: DEBUG nova.objects.instance [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'numa_topology' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:36 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:31:36 user nova-compute[75006]: INFO nova.compute.claims [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Claim successful on node user
Nov 27 03:31:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:36 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:31:36 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:31:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:37 user nova-compute[75006]: INFO nova.network.neutron [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 03:31:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquired lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG nova.network.neutron [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404ed53-d992-45cc-8fa3-8a76675041a1 req-c4d93a47-c38e-4948-9eb6-c50054373be2 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-changed-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404ed53-d992-45cc-8fa3-8a76675041a1 req-c4d93a47-c38e-4948-9eb6-c50054373be2 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Refreshing instance network info cache due to event network-changed-391a7fa7-53fe-41fc-a6c1-e49603ea7c96. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404ed53-d992-45cc-8fa3-8a76675041a1 req-c4d93a47-c38e-4948-9eb6-c50054373be2 service nova] Acquiring lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG nova.network.neutron [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating instance_info_cache with network_info: [{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Releasing lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:31:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Creating image(s)
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG nova.objects.instance [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404ed53-d992-45cc-8fa3-8a76675041a1 req-c4d93a47-c38e-4948-9eb6-c50054373be2 service nova] Acquired lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG nova.network.neutron [req-c404ed53-d992-45cc-8fa3-8a76675041a1 req-c4d93a47-c38e-4948-9eb6-c50054373be2 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Refreshing network info cache for port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG nova.objects.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<1556b696-96e5-4cd6-9246-3673235d47fc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:39 user nova-compute[75006]: DEBUG nova.virt.images [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] eddda39c-5dba-4e00-abc7-33b54b693a87 was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:31:39 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:31:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656.part /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG nova.network.neutron [req-c404ed53-d992-45cc-8fa3-8a76675041a1 req-c4d93a47-c38e-4948-9eb6-c50054373be2 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updated VIF entry in instance network info cache for port 391a7fa7-53fe-41fc-a6c1-e49603ea7c96. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG nova.network.neutron [req-c404ed53-d992-45cc-8fa3-8a76675041a1 req-c4d93a47-c38e-4948-9eb6-c50054373be2 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating instance_info_cache with network_info: [{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404ed53-d992-45cc-8fa3-8a76675041a1 req-c4d93a47-c38e-4948-9eb6-c50054373be2 service nova] Releasing lock "refresh_cache-1556b696-96e5-4cd6-9246-3673235d47fc" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656.part /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656.converted" returned: 0 in 0.349s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.935s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656 --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656 --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656,backing_fmt=raw /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656,backing_fmt=raw /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk 1073741824" returned: 0 in 0.060s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656 --force-share --output=json" returned: 0 in 0.225s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:41 user nova-compute[75006]: DEBUG nova.objects.instance [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'migration_context' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:41 user nova-compute[75006]: DEBUG nova.objects.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<1556b696-96e5-4cd6-9246-3673235d47fc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:31:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Rebasing disk image.
Nov 27 03:31:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe -F raw /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe -F raw /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk" returned: 0 in 2.484s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Ensure instance console log exists: /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Start _get_guest_xml network_info=[{"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a4cbefe2bdbb03558a16564a5c967951',container_format='bare',created_at=2023-11-27T03:29:37Z,direct_url=<?>,disk_format='qcow2',id=eddda39c-5dba-4e00-abc7-33b54b693a87,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-663731875-shelved',owner='8891478cee7d4a89bd27cd45a9732ac9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T03:29:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '448a8639-9d88-4a62-994f-e466797f50f6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoqZdzfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1556b696-96e5-4cd6-9246-3673235d47fc', 'attached_at': '', 'detached_at': '', 'volume_id': '11dbf17c-a923-4485-983e-6636832a244c', 'serial': '11dbf17c-a923-4485-983e-6636832a244c'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:31:43 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:31:43 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a4cbefe2bdbb03558a16564a5c967951',container_format='bare',created_at=2023-11-27T03:29:37Z,direct_url=<?>,disk_format='qcow2',id=eddda39c-5dba-4e00-abc7-33b54b693a87,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-663731875-shelved',owner='8891478cee7d4a89bd27cd45a9732ac9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T03:29:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.objects.instance [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:43 user nova-compute[75006]: DEBUG nova.objects.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<1556b696-96e5-4cd6-9246-3673235d47fc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoqZdzfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:44 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58ac16c-9690-48dc-b312-3d8723c10e9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:31:44 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 is timed out.
Nov 27 03:31:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully detached device vdc from instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791 from the live domain config.
Nov 27 03:31:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZNUKqvCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:31:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad105f-1feb-4ad3-a584-6a0718204a42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c] added
Nov 27 03:31:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[64778a35-7a8e-4a6d-84ad-6b71f0760606]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[525169ff-b168-42f9-99bd-820649334bec]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yoqZdzfa {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yoqZdzfa" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd03e456-536c-4e7b-b26c-1608b100e0b0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yoqZdzfa'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbce16d-1dc4-4926-9fb6-53e2884b7efe]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ae3531-0b31-44e2-a37b-8449efe9d4ae]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a976ccbb-82f3-494c-bcc2-5974db3b4e66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c, portal: 172.16.0.220,3260]
Nov 27 03:31:44 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c, portal: 172.16.0.220,3260] successful.
Nov 27 03:31:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6db4f4-94ff-4e86-8d83-5cb8de08dea7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c699e76-80eb-4387-a729-5c2e565de789]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:31:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:44 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:31:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b39e6f-6795-428b-95c2-4a64ace85bb2]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoqZdzfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:31:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23730613832623233', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730613832623233', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.309s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9bd7bd-dc82-4d39-8027-fe49f856b683]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:31:45 user nova-compute[75006]: No targets found.
Nov 27 03:31:45 user nova-compute[75006]: iSNS:
Nov 27 03:31:45 user nova-compute[75006]: No targets found.
Nov 27 03:31:45 user nova-compute[75006]: STATIC:
Nov 27 03:31:45 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95
Nov 27 03:31:45 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:45 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:45 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:31:45 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:45 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:45 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0
Nov 27 03:31:45 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:45 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:45 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c
Nov 27 03:31:45 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:31:45 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:31:45 user nova-compute[75006]: FIRMWARE:
Nov 27 03:31:45 user nova-compute[75006]: No targets found.
Nov 27 03:31:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:31:45 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:31:45 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-663731875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-663731875',id=27,image_ref='eddda39c-5dba-4e00-abc7-33b54b693a87',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-720199553',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:27:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-awbkwbnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member',shelved_at='2023-11-27T03:29:41.282760',shelved_host='user',shelved_image_id='eddda39c-5dba-4e00-abc7-33b54b693a87'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=1556b696-96e5-4cd6-9246-3673235d47fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.objects.instance [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'pci_devices' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[967a4611-aa29-4969-bb78-b0234f548fcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.objects.base [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<1556b696-96e5-4cd6-9246-3673235d47fc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:31:45 user nova-compute[75006]:   <uuid>1556b696-96e5-4cd6-9246-3673235d47fc</uuid>
Nov 27 03:31:45 user nova-compute[75006]:   <name>instance-0000001b</name>
Nov 27 03:31:45 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:31:45 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:31:45 user nova-compute[75006]:   <metadata>
Nov 27 03:31:45 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:31:45 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:31:45 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-663731875</nova:name>
Nov 27 03:31:45 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:31:43</nova:creationTime>
Nov 27 03:31:45 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:31:45 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:31:45 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:31:45 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:31:45 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:31:45 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:31:45 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:31:45 user nova-compute[75006]:       <nova:owner>
Nov 27 03:31:45 user nova-compute[75006]:         <nova:user uuid="6153e4e893d74cdcae25fae6db9fc589">tempest-AttachVolumeShelveTestJSON-392586266-project-member</nova:user>
Nov 27 03:31:45 user nova-compute[75006]:         <nova:project uuid="8891478cee7d4a89bd27cd45a9732ac9">tempest-AttachVolumeShelveTestJSON-392586266</nova:project>
Nov 27 03:31:45 user nova-compute[75006]:       </nova:owner>
Nov 27 03:31:45 user nova-compute[75006]:       <nova:root type="image" uuid="eddda39c-5dba-4e00-abc7-33b54b693a87"/>
Nov 27 03:31:45 user nova-compute[75006]:       <nova:ports>
Nov 27 03:31:45 user nova-compute[75006]:         <nova:port uuid="391a7fa7-53fe-41fc-a6c1-e49603ea7c96">
Nov 27 03:31:45 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 27 03:31:45 user nova-compute[75006]:         </nova:port>
Nov 27 03:31:45 user nova-compute[75006]:       </nova:ports>
Nov 27 03:31:45 user nova-compute[75006]:     </nova:instance>
Nov 27 03:31:45 user nova-compute[75006]:   </metadata>
Nov 27 03:31:45 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:31:45 user nova-compute[75006]:     <system>
Nov 27 03:31:45 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:31:45 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:31:45 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:31:45 user nova-compute[75006]:       <entry name="serial">1556b696-96e5-4cd6-9246-3673235d47fc</entry>
Nov 27 03:31:45 user nova-compute[75006]:       <entry name="uuid">1556b696-96e5-4cd6-9246-3673235d47fc</entry>
Nov 27 03:31:45 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:31:45 user nova-compute[75006]:     </system>
Nov 27 03:31:45 user nova-compute[75006]:   </sysinfo>
Nov 27 03:31:45 user nova-compute[75006]:   <os>
Nov 27 03:31:45 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:31:45 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:31:45 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:31:45 user nova-compute[75006]:   </os>
Nov 27 03:31:45 user nova-compute[75006]:   <features>
Nov 27 03:31:45 user nova-compute[75006]:     <acpi/>
Nov 27 03:31:45 user nova-compute[75006]:     <apic/>
Nov 27 03:31:45 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:31:45 user nova-compute[75006]:   </features>
Nov 27 03:31:45 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:31:45 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:31:45 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:31:45 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:31:45 user nova-compute[75006]:   </clock>
Nov 27 03:31:45 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:31:45 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:31:45 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:31:45 user nova-compute[75006]:   </cpu>
Nov 27 03:31:45 user nova-compute[75006]:   <devices>
Nov 27 03:31:45 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:31:45 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:31:45 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk"/>
Nov 27 03:31:45 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:31:45 user nova-compute[75006]:     </disk>
Nov 27 03:31:45 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:31:45 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:31:45 user nova-compute[75006]:       <source dev="/dev/sde"/>
Nov 27 03:31:45 user nova-compute[75006]:       <target dev="vdc" bus="virtio"/>
Nov 27 03:31:45 user nova-compute[75006]:       <serial>11dbf17c-a923-4485-983e-6636832a244c</serial>
Nov 27 03:31:45 user nova-compute[75006]:     </disk>
Nov 27 03:31:45 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:31:45 user nova-compute[75006]:       <mac address="fa:16:3e:dd:8b:c2"/>
Nov 27 03:31:45 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:31:45 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:31:45 user nova-compute[75006]:       <target dev="tap391a7fa7-53"/>
Nov 27 03:31:45 user nova-compute[75006]:     </interface>
Nov 27 03:31:45 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:31:45 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/console.log" append="off"/>
Nov 27 03:31:45 user nova-compute[75006]:     </serial>
Nov 27 03:31:45 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:31:45 user nova-compute[75006]:     <video>
Nov 27 03:31:45 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:31:45 user nova-compute[75006]:     </video>
Nov 27 03:31:45 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:31:45 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:31:45 user nova-compute[75006]:     </rng>
Nov 27 03:31:45 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:31:45 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:31:45 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:31:45 user nova-compute[75006]:     </memballoon>
Nov 27 03:31:45 user nova-compute[75006]:   </devices>
Nov 27 03:31:45 user nova-compute[75006]: </domain>
Nov 27 03:31:45 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-663731875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-663731875',id=27,image_ref='eddda39c-5dba-4e00-abc7-33b54b693a87',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-720199553',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:27:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-awbkwbnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member',shelved_at='2023-11-27T03:29:41.282760',shelved_host='user',shelved_image_id='eddda39c-5dba-4e00-abc7-33b54b693a87'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=1556b696-96e5-4cd6-9246-3673235d47fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_vif [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e171bc61-6d51-5898-be59-2cdd728c792c', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7403b54-9110-4158-9b7c-210e1f759396]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:45 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:45 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:45 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:31:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:31:45 user nova-compute[75006]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 (non-flash)
Nov 27 03:31:45 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:31:45 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:31:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4007296c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap391a7fa7-53, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap391a7fa7-53, col_values=(('qos', UUID('3d973c9e-511d-45f6-81f4-7ecb27d89cf7')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap391a7fa7-53, col_values=(('external_ids', {'iface-id': '391a7fa7-53fe-41fc-a6c1-e49603ea7c96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:8b:c2', 'vm-uuid': '1556b696-96e5-4cd6-9246-3673235d47fc'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:45 user nova-compute[75006]: INFO os_vif [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53')
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.048s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e082d21-bd7d-4947-9c8b-59a82ac745ee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[50828e48-bdd6-40bd-9df6-e2345fe26383]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a41e09-21cb-44ac-98af-3689ba398892]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No VIF found with MAC fa:16:3e:dd:8b:c2, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48dcecc-5ee9-4b04-ae4f-9ce8dd374851]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60833a3-8c29-452f-9fc8-0004cb2bfbb5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c38c37-0552-4e6d-bf62-11d3c432ef8d]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95, portal: 172.16.0.220,3260]
Nov 27 03:31:45 user nova-compute[75006]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95, portal: 172.16.0.220,3260] successful.
Nov 27 03:31:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78fb93c-b9d6-4b5c-909f-3b5602d92d95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b6e318-acd0-41bd-b2ad-daffe6d78832]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] <== disconnect_volume: return (1669ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:31:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:31:46 user nova-compute[75006]: DEBUG nova.objects.instance [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'flavor' on Instance uuid 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5b8dfe9a-0ab7-4ce3-919a-4e271edb3ed1 tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.245s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-3740a8c3-d99f-4fc4-ad34-7409eadc1b62 req-ed65d982-1834-4279-a6a1-e5c38442b648 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3740a8c3-d99f-4fc4-ad34-7409eadc1b62 req-ed65d982-1834-4279-a6a1-e5c38442b648 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3740a8c3-d99f-4fc4-ad34-7409eadc1b62 req-ed65d982-1834-4279-a6a1-e5c38442b648 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3740a8c3-d99f-4fc4-ad34-7409eadc1b62 req-ed65d982-1834-4279-a6a1-e5c38442b648 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-3740a8c3-d99f-4fc4-ad34-7409eadc1b62 req-ed65d982-1834-4279-a6a1-e5c38442b648 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:47 user nova-compute[75006]: WARNING nova.compute.manager [req-3740a8c3-d99f-4fc4-ad34-7409eadc1b62 req-ed65d982-1834-4279-a6a1-e5c38442b648 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 03:31:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:47 user nova-compute[75006]: INFO nova.compute.manager [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Terminating instance
Nov 27 03:31:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-da8547df-1fd3-42ca-a073-45b4f2b3d93a req-d623391d-d099-4236-9d5c-d19219b99f9d service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received event network-vif-unplugged-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da8547df-1fd3-42ca-a073-45b4f2b3d93a req-d623391d-d099-4236-9d5c-d19219b99f9d service nova] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da8547df-1fd3-42ca-a073-45b4f2b3d93a req-d623391d-d099-4236-9d5c-d19219b99f9d service nova] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da8547df-1fd3-42ca-a073-45b4f2b3d93a req-d623391d-d099-4236-9d5c-d19219b99f9d service nova] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-da8547df-1fd3-42ca-a073-45b4f2b3d93a req-d623391d-d099-4236-9d5c-d19219b99f9d service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] No waiting events found dispatching network-vif-unplugged-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-da8547df-1fd3-42ca-a073-45b4f2b3d93a req-d623391d-d099-4236-9d5c-d19219b99f9d service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received event network-vif-unplugged-88559c16-3699-43f5-968a-bf65e5cf194b for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:31:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Instance destroyed successfully.
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lazy-loading 'resources' on Instance uuid 8bad1d7e-9d3c-4c63-b47a-634b4874d791 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2038909523',display_name='tempest-AttachVolumeTestJSON-server-2038909523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2038909523',id=31,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe5C7zzqoYEzCYgGI4UpVN+wTWSC8LEIeC3fPNjus+CEguL9swu7I/f0PTAIw723R/eUhxPCwKckDy13gFPHh3XnnVHV9biwNEa4exrz7xHiASHRXZ4u7L0tzf+m4vqHQ==',key_name='tempest-keypair-1543023471',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:28:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c41971e35b24517acd8b84a22e14b97',ramdisk_id='',reservation_id='r-zqwfv7lr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-245260319',owner_user_name='tempest-AttachVolumeTestJSON-245260319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:28:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1275432e762e409d92b00e7c3303de53',uuid=8bad1d7e-9d3c-4c63-b47a-634b4874d791,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converting VIF {"id": "88559c16-3699-43f5-968a-bf65e5cf194b", "address": "fa:16:3e:89:8b:a2", "network": {"id": "4f1420de-3195-445f-90c9-0e59046ace71", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-790145964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c41971e35b24517acd8b84a22e14b97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88559c16-36", "ovs_interfaceid": "88559c16-3699-43f5-968a-bf65e5cf194b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:8b:a2,bridge_name='br-int',has_traffic_filtering=True,id=88559c16-3699-43f5-968a-bf65e5cf194b,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88559c16-36') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG os_vif [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8b:a2,bridge_name='br-int',has_traffic_filtering=True,id=88559c16-3699-43f5-968a-bf65e5cf194b,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88559c16-36') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88559c16-36, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ee260ea-c0a7-49a4-ab5e-2ee80bcb1929) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:31:48 user nova-compute[75006]: INFO os_vif [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:8b:a2,bridge_name='br-int',has_traffic_filtering=True,id=88559c16-3699-43f5-968a-bf65e5cf194b,network=Network(4f1420de-3195-445f-90c9-0e59046ace71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88559c16-36')
Nov 27 03:31:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Deleting instance files /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791_del
Nov 27 03:31:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Deletion of /opt/stack/data/nova/instances/8bad1d7e-9d3c-4c63-b47a-634b4874d791_del complete
Nov 27 03:31:48 user nova-compute[75006]: INFO nova.compute.manager [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 27 03:31:48 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:31:48 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:31:49 user nova-compute[75006]: INFO nova.compute.manager [None req-7d23a291-485e-461c-8039-f4b3ee7bec58 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Unrescuing
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7d23a291-485e-461c-8039-f4b3ee7bec58 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7d23a291-485e-461c-8039-f4b3ee7bec58 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquired lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7d23a291-485e-461c-8039-f4b3ee7bec58 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-ff0f1314-162a-448b-9e59-eb65b6bd9b8d req-fe636384-01a8-4138-b52b-d7952c158b63 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ff0f1314-162a-448b-9e59-eb65b6bd9b8d req-fe636384-01a8-4138-b52b-d7952c158b63 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ff0f1314-162a-448b-9e59-eb65b6bd9b8d req-fe636384-01a8-4138-b52b-d7952c158b63 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ff0f1314-162a-448b-9e59-eb65b6bd9b8d req-fe636384-01a8-4138-b52b-d7952c158b63 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-ff0f1314-162a-448b-9e59-eb65b6bd9b8d req-fe636384-01a8-4138-b52b-d7952c158b63 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:49 user nova-compute[75006]: WARNING nova.compute.manager [req-ff0f1314-162a-448b-9e59-eb65b6bd9b8d req-fe636384-01a8-4138-b52b-d7952c158b63 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:31:49 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance spawned successfully.
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7d23a291-485e-461c-8039-f4b3ee7bec58 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updating instance_info_cache with network_info: [{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7d23a291-485e-461c-8039-f4b3ee7bec58 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Releasing lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7d23a291-485e-461c-8039-f4b3ee7bec58 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'flavor' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:49 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Took 1.05 seconds to deallocate network for instance.
Nov 27 03:31:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-30747ae8-9934-4b20-ae3e-9d7527998072 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.147s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-5db2ea1f-e9dd-4f9a-bd44-820cdd9bdef2 req-114affc8-f432-49e8-94c9-aa44aff8dbbe service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5db2ea1f-e9dd-4f9a-bd44-820cdd9bdef2 req-114affc8-f432-49e8-94c9-aa44aff8dbbe service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5db2ea1f-e9dd-4f9a-bd44-820cdd9bdef2 req-114affc8-f432-49e8-94c9-aa44aff8dbbe service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5db2ea1f-e9dd-4f9a-bd44-820cdd9bdef2 req-114affc8-f432-49e8-94c9-aa44aff8dbbe service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-5db2ea1f-e9dd-4f9a-bd44-820cdd9bdef2 req-114affc8-f432-49e8-94c9-aa44aff8dbbe service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:50 user nova-compute[75006]: WARNING nova.compute.manager [req-5db2ea1f-e9dd-4f9a-bd44-820cdd9bdef2 req-114affc8-f432-49e8-94c9-aa44aff8dbbe service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:31:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-888fb16b-e163-44bb-a5c8-cc288124c926 req-ce28b8ad-44e1-492a-b27e-64a19398e322 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received event network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-888fb16b-e163-44bb-a5c8-cc288124c926 req-ce28b8ad-44e1-492a-b27e-64a19398e322 service nova] Acquiring lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-888fb16b-e163-44bb-a5c8-cc288124c926 req-ce28b8ad-44e1-492a-b27e-64a19398e322 service nova] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-888fb16b-e163-44bb-a5c8-cc288124c926 req-ce28b8ad-44e1-492a-b27e-64a19398e322 service nova] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-888fb16b-e163-44bb-a5c8-cc288124c926 req-ce28b8ad-44e1-492a-b27e-64a19398e322 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] No waiting events found dispatching network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:50 user nova-compute[75006]: WARNING nova.compute.manager [req-888fb16b-e163-44bb-a5c8-cc288124c926 req-ce28b8ad-44e1-492a-b27e-64a19398e322 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received unexpected event network-vif-plugged-88559c16-3699-43f5-968a-bf65e5cf194b for instance with vm_state deleted and task_state None.
Nov 27 03:31:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-888fb16b-e163-44bb-a5c8-cc288124c926 req-ce28b8ad-44e1-492a-b27e-64a19398e322 service nova] [instance: 8bad1d7e-9d3c-4c63-b47a-634b4874d791] Received event network-vif-deleted-88559c16-3699-43f5-968a-bf65e5cf194b {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:50 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Deleted allocations for instance 8bad1d7e-9d3c-4c63-b47a-634b4874d791
Nov 27 03:31:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3fb1a677-cad1-463d-9216-a0db77e1c0bb tempest-AttachVolumeTestJSON-245260319 tempest-AttachVolumeTestJSON-245260319-project-member] Lock "8bad1d7e-9d3c-4c63-b47a-634b4874d791" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance destroyed successfully.
Nov 27 03:31:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:52 user nova-compute[75006]: WARNING nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:52 user nova-compute[75006]: WARNING nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:52 user nova-compute[75006]: WARNING nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:52 user nova-compute[75006]: WARNING nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:52 user nova-compute[75006]: WARNING nova.compute.manager [req-c404867f-2202-4672-a784-44d4128fc757 req-f305c4a0-bd6e-4ba3-a6ad-90cf00027de2 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:31:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:54 user nova-compute[75006]: WARNING nova.compute.manager [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:31:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:31:54 user nova-compute[75006]: WARNING nova.compute.manager [req-d8841104-b798-469e-bba9-ab1ec250c85c req-628dfe0c-083e-4c73-ab40-956e472d7e8a service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:31:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7d23a291-485e-461c-8039-f4b3ee7bec58 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:31:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:31:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:31:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:31:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:31:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updating instance_info_cache with network_info: [{"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-831e3e26-daed-4b73-9470-0383e2cf6e0f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:31:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:31:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:31:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7691MB free_disk=25.227794647216797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6990b476-cfd5-43c0-a295-5ee42393d35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6b291b73-1b23-415a-ae61-f994d6e33d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 1556b696-96e5-4cd6-9246-3673235d47fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:32:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:32:01 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:32:01 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:32:01 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:32:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:32:08 user nova-compute[75006]: INFO nova.compute.manager [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] instance snapshotting
Nov 27 03:32:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Beginning live snapshot process
Nov 27 03:32:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json -f qcow2 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json -f qcow2 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5lcxo5rz/9302bf6f81a44654a8773108e160adaa.delta 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5lcxo5rz/9302bf6f81a44654a8773108e160adaa.delta 1073741824" returned: 0 in 0.053s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 03:32:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:32:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:32:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 03:32:10 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:32:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5lcxo5rz/9302bf6f81a44654a8773108e160adaa.delta /opt/stack/data/nova/instances/snapshots/tmp5lcxo5rz/9302bf6f81a44654a8773108e160adaa {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5lcxo5rz/9302bf6f81a44654a8773108e160adaa.delta /opt/stack/data/nova/instances/snapshots/tmp5lcxo5rz/9302bf6f81a44654a8773108e160adaa" returned: 0 in 0.460s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Snapshot extracted, beginning image upload
Nov 27 03:32:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Snapshot image upload complete
Nov 27 03:32:13 user nova-compute[75006]: INFO nova.compute.manager [None req-ce439002-c14e-4bf4-aaf2-c710cc26ff2a tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Took 5.56 seconds to snapshot the instance on the hypervisor.
Nov 27 03:32:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:32:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:14 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:32:14 user nova-compute[75006]: INFO nova.compute.claims [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Claim successful on node user
Nov 27 03:32:15 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:32:15 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:32:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.787s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:32:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:32:15 user nova-compute[75006]: DEBUG nova.network.neutron [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:32:15 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:32:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:32:15 user nova-compute[75006]: DEBUG nova.policy [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46cd9289539949318955d507a4b12276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67aa5c34f5fb4c07a266ad0aa94d26f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:32:16 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Creating image(s)
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "/opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "/opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "/opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.198s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk 1073741824" returned: 0 in 0.068s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.network.neutron [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Successfully created port: f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:32:16 user nova-compute[75006]: INFO nova.compute.claims [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Claim successful on node user
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Cannot resize image /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Ensure instance console log exists: /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.network.neutron [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:32:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.network.neutron [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Successfully updated port: f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "refresh_cache-6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquired lock "refresh_cache-6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.network.neutron [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-f3212e84-5162-4252-b586-7ae9123dd3c8 req-417aff11-384b-4d7a-9ee8-5d3dd9946f05 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received event network-changed-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-f3212e84-5162-4252-b586-7ae9123dd3c8 req-417aff11-384b-4d7a-9ee8-5d3dd9946f05 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Refreshing instance network info cache due to event network-changed-f68afb12-40af-47ca-af4d-7afd9b3ec623. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f3212e84-5162-4252-b586-7ae9123dd3c8 req-417aff11-384b-4d7a-9ee8-5d3dd9946f05 service nova] Acquiring lock "refresh_cache-6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.network.neutron [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.policy [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8a9fbc3a61f4c60ab5d911ebe3e5053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb74bd34122d4fde87e2ec3dee947b9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:32:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Creating image(s)
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "/opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "/opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "/opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "ae095973783c790705f36d481c4d9179c3b0830d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "ae095973783c790705f36d481c4d9179c3b0830d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:17 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:32:17 user nova-compute[75006]: INFO nova.compute.claims [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Claim successful on node user
Nov 27 03:32:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.network.neutron [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Successfully created port: 92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.network.neutron [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Updating instance_info_cache with network_info: [{"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Releasing lock "refresh_cache-6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Instance network_info: |[{"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f3212e84-5162-4252-b586-7ae9123dd3c8 req-417aff11-384b-4d7a-9ee8-5d3dd9946f05 service nova] Acquired lock "refresh_cache-6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.network.neutron [req-f3212e84-5162-4252-b586-7ae9123dd3c8 req-417aff11-384b-4d7a-9ee8-5d3dd9946f05 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Refreshing network info cache for port f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Start _get_guest_xml network_info=[{"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:32:18 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:18 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-620499010',display_name='tempest-VolumesActionsTest-instance-620499010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-620499010',id=35,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67aa5c34f5fb4c07a266ad0aa94d26f7',ramdisk_id='',reservation_id='r-fis5x9wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-535517367',owner_user_name='tempest-VolumesActionsTest-535517367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:32:16Z,user_data=None,user_id='46cd9289539949318955d507a4b12276',uuid=6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converting VIF {"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=f68afb12-40af-47ca-af4d-7afd9b3ec623,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf68afb12-40') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:32:18 user nova-compute[75006]: DEBUG nova.objects.instance [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:32:19 user nova-compute[75006]:   <uuid>6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab</uuid>
Nov 27 03:32:19 user nova-compute[75006]:   <name>instance-00000023</name>
Nov 27 03:32:19 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:32:19 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:32:19 user nova-compute[75006]:   <metadata>
Nov 27 03:32:19 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:32:19 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:32:19 user nova-compute[75006]:       <nova:name>tempest-VolumesActionsTest-instance-620499010</nova:name>
Nov 27 03:32:19 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:32:18</nova:creationTime>
Nov 27 03:32:19 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:32:19 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:32:19 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:32:19 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:32:19 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:32:19 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:32:19 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:32:19 user nova-compute[75006]:       <nova:owner>
Nov 27 03:32:19 user nova-compute[75006]:         <nova:user uuid="46cd9289539949318955d507a4b12276">tempest-VolumesActionsTest-535517367-project-member</nova:user>
Nov 27 03:32:19 user nova-compute[75006]:         <nova:project uuid="67aa5c34f5fb4c07a266ad0aa94d26f7">tempest-VolumesActionsTest-535517367</nova:project>
Nov 27 03:32:19 user nova-compute[75006]:       </nova:owner>
Nov 27 03:32:19 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:32:19 user nova-compute[75006]:       <nova:ports>
Nov 27 03:32:19 user nova-compute[75006]:         <nova:port uuid="f68afb12-40af-47ca-af4d-7afd9b3ec623">
Nov 27 03:32:19 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 03:32:19 user nova-compute[75006]:         </nova:port>
Nov 27 03:32:19 user nova-compute[75006]:       </nova:ports>
Nov 27 03:32:19 user nova-compute[75006]:     </nova:instance>
Nov 27 03:32:19 user nova-compute[75006]:   </metadata>
Nov 27 03:32:19 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:32:19 user nova-compute[75006]:     <system>
Nov 27 03:32:19 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:32:19 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:32:19 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:32:19 user nova-compute[75006]:       <entry name="serial">6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab</entry>
Nov 27 03:32:19 user nova-compute[75006]:       <entry name="uuid">6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab</entry>
Nov 27 03:32:19 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:32:19 user nova-compute[75006]:     </system>
Nov 27 03:32:19 user nova-compute[75006]:   </sysinfo>
Nov 27 03:32:19 user nova-compute[75006]:   <os>
Nov 27 03:32:19 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:32:19 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:32:19 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:32:19 user nova-compute[75006]:   </os>
Nov 27 03:32:19 user nova-compute[75006]:   <features>
Nov 27 03:32:19 user nova-compute[75006]:     <acpi/>
Nov 27 03:32:19 user nova-compute[75006]:     <apic/>
Nov 27 03:32:19 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:32:19 user nova-compute[75006]:   </features>
Nov 27 03:32:19 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:32:19 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:32:19 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:32:19 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:32:19 user nova-compute[75006]:   </clock>
Nov 27 03:32:19 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:32:19 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:32:19 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:32:19 user nova-compute[75006]:   </cpu>
Nov 27 03:32:19 user nova-compute[75006]:   <devices>
Nov 27 03:32:19 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:32:19 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:32:19 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk"/>
Nov 27 03:32:19 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:32:19 user nova-compute[75006]:     </disk>
Nov 27 03:32:19 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:32:19 user nova-compute[75006]:       <mac address="fa:16:3e:44:85:0c"/>
Nov 27 03:32:19 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:32:19 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:32:19 user nova-compute[75006]:       <target dev="tapf68afb12-40"/>
Nov 27 03:32:19 user nova-compute[75006]:     </interface>
Nov 27 03:32:19 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:32:19 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/console.log" append="off"/>
Nov 27 03:32:19 user nova-compute[75006]:     </serial>
Nov 27 03:32:19 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:32:19 user nova-compute[75006]:     <video>
Nov 27 03:32:19 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:32:19 user nova-compute[75006]:     </video>
Nov 27 03:32:19 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:32:19 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:32:19 user nova-compute[75006]:     </rng>
Nov 27 03:32:19 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:32:19 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:32:19 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:32:19 user nova-compute[75006]:     </memballoon>
Nov 27 03:32:19 user nova-compute[75006]:   </devices>
Nov 27 03:32:19 user nova-compute[75006]: </domain>
Nov 27 03:32:19 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-620499010',display_name='tempest-VolumesActionsTest-instance-620499010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-620499010',id=35,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67aa5c34f5fb4c07a266ad0aa94d26f7',ramdisk_id='',reservation_id='r-fis5x9wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-535517367',owner_user_name='tempest-VolumesActionsTest-535517367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:32:16Z,user_data=None,user_id='46cd9289539949318955d507a4b12276',uuid=6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converting VIF {"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=f68afb12-40af-47ca-af4d-7afd9b3ec623,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf68afb12-40') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG os_vif [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=f68afb12-40af-47ca-af4d-7afd9b3ec623,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf68afb12-40') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd2a79a1-bdb6-5c30-a731-641e7332c0c4', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf68afb12-40, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf68afb12-40, col_values=(('qos', UUID('043315bd-d477-43f0-b564-1fbba2798dd2')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf68afb12-40, col_values=(('external_ids', {'iface-id': 'f68afb12-40af-47ca-af4d-7afd9b3ec623', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:85:0c', 'vm-uuid': '6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d.part --force-share --output=json" returned: 0 in 0.217s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.virt.images [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] f23c80e3-4a81-4687-9a79-41ea2a3e79b9 was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d.part /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:19 user nova-compute[75006]: INFO os_vif [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=f68afb12-40af-47ca-af4d-7afd9b3ec623,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf68afb12-40')
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] No VIF found with MAC fa:16:3e:44:85:0c, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d.part /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d.converted" returned: 0 in 0.359s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-f3212e84-5162-4252-b586-7ae9123dd3c8 req-417aff11-384b-4d7a-9ee8-5d3dd9946f05 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Updated VIF entry in instance network info cache for port f68afb12-40af-47ca-af4d-7afd9b3ec623. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-f3212e84-5162-4252-b586-7ae9123dd3c8 req-417aff11-384b-4d7a-9ee8-5d3dd9946f05 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Updating instance_info_cache with network_info: [{"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f3212e84-5162-4252-b586-7ae9123dd3c8 req-417aff11-384b-4d7a-9ee8-5d3dd9946f05 service nova] Releasing lock "refresh_cache-6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "ae095973783c790705f36d481c4d9179c3b0830d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.946s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Successfully updated port: 92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquired lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-01fa6ee6-b0f9-42f6-a841-e3546d5e7462 req-9350d280-24db-41fa-bf50-f54b03f730b0 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-changed-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-01fa6ee6-b0f9-42f6-a841-e3546d5e7462 req-9350d280-24db-41fa-bf50-f54b03f730b0 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Refreshing instance network info cache due to event network-changed-92f23dbf-0296-4f81-ba74-65e74dd75d0a. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-01fa6ee6-b0f9-42f6-a841-e3546d5e7462 req-9350d280-24db-41fa-bf50-f54b03f730b0 service nova] Acquiring lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.027s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d --force-share --output=json" returned: 0 in 0.241s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "ae095973783c790705f36d481c4d9179c3b0830d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "ae095973783c790705f36d481c4d9179c3b0830d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:19 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.policy [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4a327fa49cc468f8cbf23ae2d6d30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa566d4c0fd4cbdbaf2b67ac2cea59a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d,backing_fmt=raw /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:32:20 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Creating image(s)
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.network.neutron [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updating instance_info_cache with network_info: [{"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Releasing lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Instance network_info: |[{"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d,backing_fmt=raw /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk 1073741824" returned: 0 in 0.126s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-01fa6ee6-b0f9-42f6-a841-e3546d5e7462 req-9350d280-24db-41fa-bf50-f54b03f730b0 service nova] Acquired lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.network.neutron [req-01fa6ee6-b0f9-42f6-a841-e3546d5e7462 req-9350d280-24db-41fa-bf50-f54b03f730b0 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Refreshing network info cache for port 92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "ae095973783c790705f36d481c4d9179c3b0830d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d --force-share --output=json" returned: 0 in 0.210s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Ensure instance console log exists: /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Start _get_guest_xml network_info=[{"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7e8d2d42ddf3420321235fe006a5a91d',container_format='bare',created_at=2023-11-27T03:32:08Z,direct_url=<?>,disk_format='qcow2',id=f23c80e3-4a81-4687-9a79-41ea2a3e79b9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-51831021',owner='bb74bd34122d4fde87e2ec3dee947b9d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-27T03:32:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'f23c80e3-4a81-4687-9a79-41ea2a3e79b9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:32:20 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:20 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7e8d2d42ddf3420321235fe006a5a91d',container_format='bare',created_at=2023-11-27T03:32:08Z,direct_url=<?>,disk_format='qcow2',id=f23c80e3-4a81-4687-9a79-41ea2a3e79b9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-51831021',owner='bb74bd34122d4fde87e2ec3dee947b9d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-27T03:32:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1003990568',display_name='tempest-TestStampPattern-server-1003990568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1003990568',id=36,image_ref='f23c80e3-4a81-4687-9a79-41ea2a3e79b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCvEMUIZDar/9uKmjM+iVQHTuryauOaSvt4utJ6Dze5XI9Qu+OWQuvie19iCR6iK3Kap2FXhDlTmZNuKNo1KhaH5r71CU3Tiaop1CqRcF45PpszmuxGaWkGiSqEIk0MhA==',key_name='tempest-TestStampPattern-920267456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb74bd34122d4fde87e2ec3dee947b9d',ramdisk_id='',reservation_id='r-ld6r99i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6990b476-cfd5-43c0-a295-5ee42393d35b',image_min_disk='1',image_min_ram='0',image_owner_id='bb74bd34122d4fde87e2ec3dee947b9d',image_owner_project_name='tempest-TestStampPattern-250178234',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-250178234-project-member',image_user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',network_allocated='True',owner_project_name='tempest-TestStampPattern-250178234',owner_user_name='tempest-TestStampPattern-250178234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:32:18Z,user_data=None,user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',uuid=80529600-0aed-4f2b-b8ce-f3bacaabcd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converting VIF {"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=92f23dbf-0296-4f81-ba74-65e74dd75d0a,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f23dbf-02') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.objects.instance [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'pci_devices' on Instance uuid 80529600-0aed-4f2b-b8ce-f3bacaabcd0e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:32:20 user nova-compute[75006]:   <uuid>80529600-0aed-4f2b-b8ce-f3bacaabcd0e</uuid>
Nov 27 03:32:20 user nova-compute[75006]:   <name>instance-00000024</name>
Nov 27 03:32:20 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:32:20 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:32:20 user nova-compute[75006]:   <metadata>
Nov 27 03:32:20 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:32:20 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:32:20 user nova-compute[75006]:       <nova:name>tempest-TestStampPattern-server-1003990568</nova:name>
Nov 27 03:32:20 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:32:20</nova:creationTime>
Nov 27 03:32:20 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:32:20 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:32:20 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:32:20 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:32:20 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:32:20 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:32:20 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:32:20 user nova-compute[75006]:       <nova:owner>
Nov 27 03:32:20 user nova-compute[75006]:         <nova:user uuid="e8a9fbc3a61f4c60ab5d911ebe3e5053">tempest-TestStampPattern-250178234-project-member</nova:user>
Nov 27 03:32:20 user nova-compute[75006]:         <nova:project uuid="bb74bd34122d4fde87e2ec3dee947b9d">tempest-TestStampPattern-250178234</nova:project>
Nov 27 03:32:20 user nova-compute[75006]:       </nova:owner>
Nov 27 03:32:20 user nova-compute[75006]:       <nova:root type="image" uuid="f23c80e3-4a81-4687-9a79-41ea2a3e79b9"/>
Nov 27 03:32:20 user nova-compute[75006]:       <nova:ports>
Nov 27 03:32:20 user nova-compute[75006]:         <nova:port uuid="92f23dbf-0296-4f81-ba74-65e74dd75d0a">
Nov 27 03:32:20 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:32:20 user nova-compute[75006]:         </nova:port>
Nov 27 03:32:20 user nova-compute[75006]:       </nova:ports>
Nov 27 03:32:20 user nova-compute[75006]:     </nova:instance>
Nov 27 03:32:20 user nova-compute[75006]:   </metadata>
Nov 27 03:32:20 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:32:20 user nova-compute[75006]:     <system>
Nov 27 03:32:20 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:32:20 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:32:20 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:32:20 user nova-compute[75006]:       <entry name="serial">80529600-0aed-4f2b-b8ce-f3bacaabcd0e</entry>
Nov 27 03:32:20 user nova-compute[75006]:       <entry name="uuid">80529600-0aed-4f2b-b8ce-f3bacaabcd0e</entry>
Nov 27 03:32:20 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:32:20 user nova-compute[75006]:     </system>
Nov 27 03:32:20 user nova-compute[75006]:   </sysinfo>
Nov 27 03:32:20 user nova-compute[75006]:   <os>
Nov 27 03:32:20 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:32:20 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:32:20 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:32:20 user nova-compute[75006]:   </os>
Nov 27 03:32:20 user nova-compute[75006]:   <features>
Nov 27 03:32:20 user nova-compute[75006]:     <acpi/>
Nov 27 03:32:20 user nova-compute[75006]:     <apic/>
Nov 27 03:32:20 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:32:20 user nova-compute[75006]:   </features>
Nov 27 03:32:20 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:32:20 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:32:20 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:32:20 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:32:20 user nova-compute[75006]:   </clock>
Nov 27 03:32:20 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:32:20 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:32:20 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:32:20 user nova-compute[75006]:   </cpu>
Nov 27 03:32:20 user nova-compute[75006]:   <devices>
Nov 27 03:32:20 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:32:20 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:32:20 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk"/>
Nov 27 03:32:20 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:32:20 user nova-compute[75006]:     </disk>
Nov 27 03:32:20 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:32:20 user nova-compute[75006]:       <mac address="fa:16:3e:44:bc:68"/>
Nov 27 03:32:20 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:32:20 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:32:20 user nova-compute[75006]:       <target dev="tap92f23dbf-02"/>
Nov 27 03:32:20 user nova-compute[75006]:     </interface>
Nov 27 03:32:20 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:32:20 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/console.log" append="off"/>
Nov 27 03:32:20 user nova-compute[75006]:     </serial>
Nov 27 03:32:20 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:32:20 user nova-compute[75006]:     <video>
Nov 27 03:32:20 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:32:20 user nova-compute[75006]:     </video>
Nov 27 03:32:20 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:32:20 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:32:20 user nova-compute[75006]:     </rng>
Nov 27 03:32:20 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:32:20 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:32:20 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:32:20 user nova-compute[75006]:     </memballoon>
Nov 27 03:32:20 user nova-compute[75006]:   </devices>
Nov 27 03:32:20 user nova-compute[75006]: </domain>
Nov 27 03:32:20 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1003990568',display_name='tempest-TestStampPattern-server-1003990568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1003990568',id=36,image_ref='f23c80e3-4a81-4687-9a79-41ea2a3e79b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCvEMUIZDar/9uKmjM+iVQHTuryauOaSvt4utJ6Dze5XI9Qu+OWQuvie19iCR6iK3Kap2FXhDlTmZNuKNo1KhaH5r71CU3Tiaop1CqRcF45PpszmuxGaWkGiSqEIk0MhA==',key_name='tempest-TestStampPattern-920267456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb74bd34122d4fde87e2ec3dee947b9d',ramdisk_id='',reservation_id='r-ld6r99i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6990b476-cfd5-43c0-a295-5ee42393d35b',image_min_disk='1',image_min_ram='0',image_owner_id='bb74bd34122d4fde87e2ec3dee947b9d',image_owner_project_name='tempest-TestStampPattern-250178234',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-250178234-project-member',image_user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',network_allocated='True',owner_project_name='tempest-TestStampPattern-250178234',owner_user_name='tempest-TestStampPattern-250178234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:32:18Z,user_data=None,user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',uuid=80529600-0aed-4f2b-b8ce-f3bacaabcd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converting VIF {"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=92f23dbf-0296-4f81-ba74-65e74dd75d0a,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f23dbf-02') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG os_vif [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=92f23dbf-0296-4f81-ba74-65e74dd75d0a,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f23dbf-02') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86a9fe89-3eaf-59be-be61-68d1418ce9c1', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk 1073741824" returned: 0 in 0.059s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92f23dbf-02, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92f23dbf-02, col_values=(('qos', UUID('fffab4b7-67d4-4293-a431-54cd9e207c7e')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92f23dbf-02, col_values=(('external_ids', {'iface-id': '92f23dbf-0296-4f81-ba74-65e74dd75d0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:bc:68', 'vm-uuid': '80529600-0aed-4f2b-b8ce-f3bacaabcd0e'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: INFO os_vif [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=92f23dbf-0296-4f81-ba74-65e74dd75d0a,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f23dbf-02')
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No VIF found with MAC fa:16:3e:44:bc:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.238s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:32:20 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG nova.network.neutron [req-01fa6ee6-b0f9-42f6-a841-e3546d5e7462 req-9350d280-24db-41fa-bf50-f54b03f730b0 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updated VIF entry in instance network info cache for port 92f23dbf-0296-4f81-ba74-65e74dd75d0a. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG nova.network.neutron [req-01fa6ee6-b0f9-42f6-a841-e3546d5e7462 req-9350d280-24db-41fa-bf50-f54b03f730b0 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updating instance_info_cache with network_info: [{"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Cannot resize image /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Ensure instance console log exists: /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-01fa6ee6-b0f9-42f6-a841-e3546d5e7462 req-9350d280-24db-41fa-bf50-f54b03f730b0 service nova] Releasing lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-aa90c617-2b42-4a8f-8f0a-39beec2267eb req-4a761e8e-2ed3-4848-adfc-c47f6a281bd4 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received event network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa90c617-2b42-4a8f-8f0a-39beec2267eb req-4a761e8e-2ed3-4848-adfc-c47f6a281bd4 service nova] Acquiring lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa90c617-2b42-4a8f-8f0a-39beec2267eb req-4a761e8e-2ed3-4848-adfc-c47f6a281bd4 service nova] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa90c617-2b42-4a8f-8f0a-39beec2267eb req-4a761e8e-2ed3-4848-adfc-c47f6a281bd4 service nova] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-aa90c617-2b42-4a8f-8f0a-39beec2267eb req-4a761e8e-2ed3-4848-adfc-c47f6a281bd4 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] No waiting events found dispatching network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:21 user nova-compute[75006]: WARNING nova.compute.manager [req-aa90c617-2b42-4a8f-8f0a-39beec2267eb req-4a761e8e-2ed3-4848-adfc-c47f6a281bd4 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received unexpected event network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 for instance with vm_state building and task_state spawning.
Nov 27 03:32:21 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Successfully created port: 5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Successfully updated port: 5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquired lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Updating instance_info_cache with network_info: [{"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Releasing lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance network_info: |[{"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Start _get_guest_xml network_info=[{"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:32:22 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:22 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1685619028',display_name='tempest-tempest.common.compute-instance-1685619028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1685619028',id=37,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJFag2C77Tr4nhzxnc0tm5TpQOuqVamXe4nj4+Gk0KLzruErQ1k55s6Q8TO/stZcCT/wG7GOz0KVNgIVylEg5hU4pI8NSFtZskqPXMaykMNZszlWg7dAkBUiuxwzVsSCQ==',key_name='tempest-keypair-1724189151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-zh8vdx7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=5449b27f-2795-4ab6-a965-bdbbe9a9a59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'pci_devices' on Instance uuid 5449b27f-2795-4ab6-a965-bdbbe9a9a59f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:32:22 user nova-compute[75006]:   <uuid>5449b27f-2795-4ab6-a965-bdbbe9a9a59f</uuid>
Nov 27 03:32:22 user nova-compute[75006]:   <name>instance-00000025</name>
Nov 27 03:32:22 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:32:22 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:32:22 user nova-compute[75006]:   <metadata>
Nov 27 03:32:22 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:32:22 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:32:22 user nova-compute[75006]:       <nova:name>tempest-tempest.common.compute-instance-1685619028</nova:name>
Nov 27 03:32:22 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:32:22</nova:creationTime>
Nov 27 03:32:22 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:32:22 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:32:22 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:32:22 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:32:22 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:32:22 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:32:22 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:32:22 user nova-compute[75006]:       <nova:owner>
Nov 27 03:32:22 user nova-compute[75006]:         <nova:user uuid="d4a327fa49cc468f8cbf23ae2d6d30d1">tempest-ServerActionsTestOtherA-507729530-project-member</nova:user>
Nov 27 03:32:22 user nova-compute[75006]:         <nova:project uuid="daa566d4c0fd4cbdbaf2b67ac2cea59a">tempest-ServerActionsTestOtherA-507729530</nova:project>
Nov 27 03:32:22 user nova-compute[75006]:       </nova:owner>
Nov 27 03:32:22 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:32:22 user nova-compute[75006]:       <nova:ports>
Nov 27 03:32:22 user nova-compute[75006]:         <nova:port uuid="5cc2684b-5d2c-4b80-8516-3838a2b54771">
Nov 27 03:32:22 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 03:32:22 user nova-compute[75006]:         </nova:port>
Nov 27 03:32:22 user nova-compute[75006]:       </nova:ports>
Nov 27 03:32:22 user nova-compute[75006]:     </nova:instance>
Nov 27 03:32:22 user nova-compute[75006]:   </metadata>
Nov 27 03:32:22 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:32:22 user nova-compute[75006]:     <system>
Nov 27 03:32:22 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:32:22 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:32:22 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:32:22 user nova-compute[75006]:       <entry name="serial">5449b27f-2795-4ab6-a965-bdbbe9a9a59f</entry>
Nov 27 03:32:22 user nova-compute[75006]:       <entry name="uuid">5449b27f-2795-4ab6-a965-bdbbe9a9a59f</entry>
Nov 27 03:32:22 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:32:22 user nova-compute[75006]:     </system>
Nov 27 03:32:22 user nova-compute[75006]:   </sysinfo>
Nov 27 03:32:22 user nova-compute[75006]:   <os>
Nov 27 03:32:22 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:32:22 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:32:22 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:32:22 user nova-compute[75006]:   </os>
Nov 27 03:32:22 user nova-compute[75006]:   <features>
Nov 27 03:32:22 user nova-compute[75006]:     <acpi/>
Nov 27 03:32:22 user nova-compute[75006]:     <apic/>
Nov 27 03:32:22 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:32:22 user nova-compute[75006]:   </features>
Nov 27 03:32:22 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:32:22 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:32:22 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:32:22 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:32:22 user nova-compute[75006]:   </clock>
Nov 27 03:32:22 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:32:22 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:32:22 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:32:22 user nova-compute[75006]:   </cpu>
Nov 27 03:32:22 user nova-compute[75006]:   <devices>
Nov 27 03:32:22 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:32:22 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:32:22 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk"/>
Nov 27 03:32:22 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:32:22 user nova-compute[75006]:     </disk>
Nov 27 03:32:22 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:32:22 user nova-compute[75006]:       <mac address="fa:16:3e:e6:23:80"/>
Nov 27 03:32:22 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:32:22 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:32:22 user nova-compute[75006]:       <target dev="tap5cc2684b-5d"/>
Nov 27 03:32:22 user nova-compute[75006]:     </interface>
Nov 27 03:32:22 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:32:22 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/console.log" append="off"/>
Nov 27 03:32:22 user nova-compute[75006]:     </serial>
Nov 27 03:32:22 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:32:22 user nova-compute[75006]:     <video>
Nov 27 03:32:22 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:32:22 user nova-compute[75006]:     </video>
Nov 27 03:32:22 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:32:22 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:32:22 user nova-compute[75006]:     </rng>
Nov 27 03:32:22 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:32:22 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:32:22 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:32:22 user nova-compute[75006]:     </memballoon>
Nov 27 03:32:22 user nova-compute[75006]:   </devices>
Nov 27 03:32:22 user nova-compute[75006]: </domain>
Nov 27 03:32:22 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1685619028',display_name='tempest-tempest.common.compute-instance-1685619028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1685619028',id=37,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJFag2C77Tr4nhzxnc0tm5TpQOuqVamXe4nj4+Gk0KLzruErQ1k55s6Q8TO/stZcCT/wG7GOz0KVNgIVylEg5hU4pI8NSFtZskqPXMaykMNZszlWg7dAkBUiuxwzVsSCQ==',key_name='tempest-keypair-1724189151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-zh8vdx7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:32:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=5449b27f-2795-4ab6-a965-bdbbe9a9a59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG os_vif [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f09402b-fc18-5165-996b-f20f02c6d4a2', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cc2684b-5d, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cc2684b-5d, col_values=(('qos', UUID('e5d981fb-1f69-4727-9166-9bdfa0493809')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cc2684b-5d, col_values=(('external_ids', {'iface-id': '5cc2684b-5d2c-4b80-8516-3838a2b54771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:23:80', 'vm-uuid': '5449b27f-2795-4ab6-a965-bdbbe9a9a59f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: INFO os_vif [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d')
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No VIF found with MAC fa:16:3e:e6:23:80, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-b72106b6-b93d-49e8-8dca-c585ed400613 req-8afa25cd-92cf-403a-8313-390acb5a86e1 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b72106b6-b93d-49e8-8dca-c585ed400613 req-8afa25cd-92cf-403a-8313-390acb5a86e1 service nova] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b72106b6-b93d-49e8-8dca-c585ed400613 req-8afa25cd-92cf-403a-8313-390acb5a86e1 service nova] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b72106b6-b93d-49e8-8dca-c585ed400613 req-8afa25cd-92cf-403a-8313-390acb5a86e1 service nova] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-b72106b6-b93d-49e8-8dca-c585ed400613 req-8afa25cd-92cf-403a-8313-390acb5a86e1 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] No waiting events found dispatching network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:22 user nova-compute[75006]: WARNING nova.compute.manager [req-b72106b6-b93d-49e8-8dca-c585ed400613 req-8afa25cd-92cf-403a-8313-390acb5a86e1 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received unexpected event network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a for instance with vm_state building and task_state spawning.
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received event network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] Acquiring lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] No waiting events found dispatching network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:23 user nova-compute[75006]: WARNING nova.compute.manager [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received unexpected event network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 for instance with vm_state building and task_state spawning.
Nov 27 03:32:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-changed-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Refreshing instance network info cache due to event network-changed-5cc2684b-5d2c-4b80-8516-3838a2b54771. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] Acquiring lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] Acquired lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:23 user nova-compute[75006]: DEBUG nova.network.neutron [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Refreshing network info cache for port 5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.network.neutron [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Updated VIF entry in instance network info cache for port 5cc2684b-5d2c-4b80-8516-3838a2b54771. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.network.neutron [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Updating instance_info_cache with network_info: [{"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b897c80d-7c6c-41b2-9a8a-a1ff5e83fe1d req-7166ff5b-f42a-4ab7-a02c-c536476efb97 service nova] Releasing lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:32:24 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Instance spawned successfully.
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:24 user nova-compute[75006]: INFO nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Took 8.71 seconds to spawn the instance on the hypervisor.
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] No waiting events found dispatching network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:24 user nova-compute[75006]: WARNING nova.compute.manager [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received unexpected event network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a for instance with vm_state building and task_state spawning.
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] No waiting events found dispatching network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:24 user nova-compute[75006]: WARNING nova.compute.manager [req-a674952a-7792-4a6b-a0d1-69041d157498 req-0c20d4e4-e813-45cd-9d18-03c0a3891c2f service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received unexpected event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 for instance with vm_state building and task_state spawning.
Nov 27 03:32:24 user nova-compute[75006]: INFO nova.compute.manager [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Took 10.08 seconds to build instance.
Nov 27 03:32:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-128858cf-3925-44e4-a194-a40ff2b669ea tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.201s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:32:26 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Instance spawned successfully.
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:26 user nova-compute[75006]: INFO nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Took 8.80 seconds to spawn the instance on the hypervisor.
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:32:26 user nova-compute[75006]: INFO nova.compute.manager [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Took 9.90 seconds to build instance.
Nov 27 03:32:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d38aad35-e357-43d8-97ad-c801f7d50396 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.028s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:32:26 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance spawned successfully.
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:32:26 user nova-compute[75006]: INFO nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-aff764f9-bd2a-48e8-a6c6-cf8d3e74028e req-13019f62-c50d-4e19-90c7-8c3e9ec4d74b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aff764f9-bd2a-48e8-a6c6-cf8d3e74028e req-13019f62-c50d-4e19-90c7-8c3e9ec4d74b service nova] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aff764f9-bd2a-48e8-a6c6-cf8d3e74028e req-13019f62-c50d-4e19-90c7-8c3e9ec4d74b service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aff764f9-bd2a-48e8-a6c6-cf8d3e74028e req-13019f62-c50d-4e19-90c7-8c3e9ec4d74b service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-aff764f9-bd2a-48e8-a6c6-cf8d3e74028e req-13019f62-c50d-4e19-90c7-8c3e9ec4d74b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] No waiting events found dispatching network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:26 user nova-compute[75006]: WARNING nova.compute.manager [req-aff764f9-bd2a-48e8-a6c6-cf8d3e74028e req-13019f62-c50d-4e19-90c7-8c3e9ec4d74b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received unexpected event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 for instance with vm_state building and task_state spawning.
Nov 27 03:32:26 user nova-compute[75006]: INFO nova.compute.manager [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Took 9.18 seconds to build instance.
Nov 27 03:32:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7064cf5f-04b2-4ca1-a72f-41198522af3e tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.296s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-ae895ed8-9f90-4b8e-9730-5136181c0d59 req-1ebe7179-89a5-4da1-af3a-5a6f8ba012a4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-changed-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-ae895ed8-9f90-4b8e-9730-5136181c0d59 req-1ebe7179-89a5-4da1-af3a-5a6f8ba012a4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Refreshing instance network info cache due to event network-changed-1fc740fe-93b7-49bc-8136-86b411ec34c0. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ae895ed8-9f90-4b8e-9730-5136181c0d59 req-1ebe7179-89a5-4da1-af3a-5a6f8ba012a4 service nova] Acquiring lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ae895ed8-9f90-4b8e-9730-5136181c0d59 req-1ebe7179-89a5-4da1-af3a-5a6f8ba012a4 service nova] Acquired lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-ae895ed8-9f90-4b8e-9730-5136181c0d59 req-1ebe7179-89a5-4da1-af3a-5a6f8ba012a4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Refreshing network info cache for port 1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'flavor' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:31 user nova-compute[75006]: INFO nova.compute.manager [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Attaching volume 783cb71c-489b-4a70-8c97-3fdd6afba4f5 to /dev/vdb
Nov 27 03:32:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-ae895ed8-9f90-4b8e-9730-5136181c0d59 req-1ebe7179-89a5-4da1-af3a-5a6f8ba012a4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updated VIF entry in instance network info cache for port 1fc740fe-93b7-49bc-8136-86b411ec34c0. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG nova.network.neutron [req-ae895ed8-9f90-4b8e-9730-5136181c0d59 req-1ebe7179-89a5-4da1-af3a-5a6f8ba012a4 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating instance_info_cache with network_info: [{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG os_brick.utils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ae895ed8-9f90-4b8e-9730-5136181c0d59 req-1ebe7179-89a5-4da1-af3a-5a6f8ba012a4 service nova] Releasing lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d206ea-7c88-443f-bc15-a01b7b44efb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c9aa0-2f20-4fad-aba4-3dce5d4db168]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.122s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d96c9d-d0a8-4178-8e84-cd6a4d544618]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[533fcfa9-3466-45c0-9764-9c427aa5720d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:32:31 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:32:31 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1bf6a3-4da1-479b-a68b-123b9d09218f]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG os_brick.utils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] <== get_connector_properties: return (243ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:32:31 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating existing volume attachment record: 37c948f8-1fa6-4df2-99f6-06f04a6c4d9d {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:32:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEeSXURa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:32:38 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:32:38 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:32:38 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[627d8f67-0b64-43f4-9e07-4725fc469081]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:32:38 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[75acd48f-27b0-4f99-803f-f4e1628e7063]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5] added
Nov 27 03:32:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8cf6f2-8ec1-4190-b145-2bbd909ba31b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[249554b9-e1cd-4d24-b61f-c81e22ece2c5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hEeSXURa {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hEeSXURa" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad5259c-54a2-4d6c-b9e9-24a0ca0fdc96]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hEeSXURa'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea9a94b-20e4-49f9-8df4-cca2ab98a3d0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a053cdb-ca66-4a0d-ab75-7fa216c02432]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:32:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:32:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30856aa7-a173-44fe-bc40-3d8acf0bb93a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5, portal: 172.16.0.220,3260]
Nov 27 03:32:38 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5, portal: 172.16.0.220,3260] successful.
Nov 27 03:32:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbac3ca-d418-489d-96e9-0b9630af6043]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f71fe22-b11e-4346-be7d-1ca40443d06f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:32:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:32:38 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:32:38 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8edb5d-a8ff-4296-8ac1-3b2d790a7c9c]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:32:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEeSXURa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:32:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:32:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23039333936623035', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:32:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039333936623035', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:32:39 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'flavor' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:32:39 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:32:39 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:32:39 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:32:39 user nova-compute[75006]:   <serial>783cb71c-489b-4a70-8c97-3fdd6afba4f5</serial>
Nov 27 03:32:39 user nova-compute[75006]: </disk>
Nov 27 03:32:39 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:32:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:32:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:32:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No VIF found with MAC fa:16:3e:64:05:65, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:32:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7ea06404-33e2-4531-8e9a-61d9d3723068 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.289s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:41 user nova-compute[75006]: INFO nova.compute.manager [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Rescuing
Nov 27 03:32:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquired lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:32:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating instance_info_cache with network_info: [{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Releasing lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-fdaf057c-5c86-408a-8c05-3ffa6f68dc3d req-94537585-1113-4c28-b273-630e0de32da8 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fdaf057c-5c86-408a-8c05-3ffa6f68dc3d req-94537585-1113-4c28-b273-630e0de32da8 service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fdaf057c-5c86-408a-8c05-3ffa6f68dc3d req-94537585-1113-4c28-b273-630e0de32da8 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fdaf057c-5c86-408a-8c05-3ffa6f68dc3d req-94537585-1113-4c28-b273-630e0de32da8 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-fdaf057c-5c86-408a-8c05-3ffa6f68dc3d req-94537585-1113-4c28-b273-630e0de32da8 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:42 user nova-compute[75006]: WARNING nova.compute.manager [req-fdaf057c-5c86-408a-8c05-3ffa6f68dc3d req-94537585-1113-4c28-b273-630e0de32da8 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state active and task_state rescuing.
Nov 27 03:32:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance destroyed successfully.
Nov 27 03:32:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Attempting rescue
Nov 27 03:32:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75006) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance directory exists: not creating {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 03:32:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Creating image(s)
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue" returned: 0 in 0.049s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.instance [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'migration_context' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.base [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<6b291b73-1b23-415a-ae61-f994d6e33d7e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Start _get_guest_xml network_info=[{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:64:05:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.instance [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'resources' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.base [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<6b291b73-1b23-415a-ae61-f994d6e33d7e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.instance [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.base [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<6b291b73-1b23-415a-ae61-f994d6e33d7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:32:43 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:43 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.instance [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.base [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<6b291b73-1b23-415a-ae61-f994d6e33d7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-32047452',display_name='tempest-ServerRescueNegativeTestJSON-server-32047452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-32047452',id=34,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4gqSavu/0+EshxWYO2Gl7WlMV6CsX979Tv3dWfmDW218WUXmQEX88lY8YM5vbXjzZ6oatayWjI3POVeLYOzNGGgyXX9jWgt3r1ix5SHG/ItK3E3AZfrZvKSFwpdm2UOA==',key_name='tempest-keypair-892943442',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-40sm8ndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797a8975406044ddabaad6e23950a71b',uuid=6b291b73-1b23-415a-ae61-f994d6e33d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:64:05:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "vif_mac": "fa:16:3e:64:05:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:05:65,bridge_name='br-int',has_traffic_filtering=True,id=1fc740fe-93b7-49bc-8136-86b411ec34c0,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc740fe-93') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.instance [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.objects.base [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Object Instance<6b291b73-1b23-415a-ae61-f994d6e33d7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:32:43 user nova-compute[75006]:   <uuid>6b291b73-1b23-415a-ae61-f994d6e33d7e</uuid>
Nov 27 03:32:43 user nova-compute[75006]:   <name>instance-00000022</name>
Nov 27 03:32:43 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:32:43 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:32:43 user nova-compute[75006]:   <metadata>
Nov 27 03:32:43 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:32:43 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:32:43 user nova-compute[75006]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-32047452</nova:name>
Nov 27 03:32:43 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:32:43</nova:creationTime>
Nov 27 03:32:43 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:32:43 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:32:43 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:32:43 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:32:43 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:32:43 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:32:43 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:32:43 user nova-compute[75006]:       <nova:owner>
Nov 27 03:32:43 user nova-compute[75006]:         <nova:user uuid="797a8975406044ddabaad6e23950a71b">tempest-ServerRescueNegativeTestJSON-599355303-project-member</nova:user>
Nov 27 03:32:43 user nova-compute[75006]:         <nova:project uuid="7b2d179ed36d41038da75b63b1bde170">tempest-ServerRescueNegativeTestJSON-599355303</nova:project>
Nov 27 03:32:43 user nova-compute[75006]:       </nova:owner>
Nov 27 03:32:43 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:32:43 user nova-compute[75006]:       <nova:ports>
Nov 27 03:32:43 user nova-compute[75006]:         <nova:port uuid="1fc740fe-93b7-49bc-8136-86b411ec34c0">
Nov 27 03:32:43 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 03:32:43 user nova-compute[75006]:         </nova:port>
Nov 27 03:32:43 user nova-compute[75006]:       </nova:ports>
Nov 27 03:32:43 user nova-compute[75006]:     </nova:instance>
Nov 27 03:32:43 user nova-compute[75006]:   </metadata>
Nov 27 03:32:43 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:32:43 user nova-compute[75006]:     <system>
Nov 27 03:32:43 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:32:43 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:32:43 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:32:43 user nova-compute[75006]:       <entry name="serial">6b291b73-1b23-415a-ae61-f994d6e33d7e</entry>
Nov 27 03:32:43 user nova-compute[75006]:       <entry name="uuid">6b291b73-1b23-415a-ae61-f994d6e33d7e</entry>
Nov 27 03:32:43 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:32:43 user nova-compute[75006]:     </system>
Nov 27 03:32:43 user nova-compute[75006]:   </sysinfo>
Nov 27 03:32:43 user nova-compute[75006]:   <os>
Nov 27 03:32:43 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:32:43 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:32:43 user nova-compute[75006]:   </os>
Nov 27 03:32:43 user nova-compute[75006]:   <features>
Nov 27 03:32:43 user nova-compute[75006]:     <acpi/>
Nov 27 03:32:43 user nova-compute[75006]:     <apic/>
Nov 27 03:32:43 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:32:43 user nova-compute[75006]:   </features>
Nov 27 03:32:43 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:32:43 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:32:43 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:32:43 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:32:43 user nova-compute[75006]:   </clock>
Nov 27 03:32:43 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:32:43 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:32:43 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:32:43 user nova-compute[75006]:   </cpu>
Nov 27 03:32:43 user nova-compute[75006]:   <devices>
Nov 27 03:32:43 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:32:43 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:32:43 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue"/>
Nov 27 03:32:43 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:32:43 user nova-compute[75006]:     </disk>
Nov 27 03:32:43 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:32:43 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:32:43 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk"/>
Nov 27 03:32:43 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:32:43 user nova-compute[75006]:     </disk>
Nov 27 03:32:43 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:32:43 user nova-compute[75006]:       <mac address="fa:16:3e:64:05:65"/>
Nov 27 03:32:43 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:32:43 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:32:43 user nova-compute[75006]:       <target dev="tap1fc740fe-93"/>
Nov 27 03:32:43 user nova-compute[75006]:     </interface>
Nov 27 03:32:43 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:32:43 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/console.log" append="off"/>
Nov 27 03:32:43 user nova-compute[75006]:     </serial>
Nov 27 03:32:43 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:32:43 user nova-compute[75006]:     <video>
Nov 27 03:32:43 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:32:43 user nova-compute[75006]:     </video>
Nov 27 03:32:43 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:32:43 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:32:43 user nova-compute[75006]:     </rng>
Nov 27 03:32:43 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:32:43 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:32:43 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:32:43 user nova-compute[75006]:     </memballoon>
Nov 27 03:32:43 user nova-compute[75006]:   </devices>
Nov 27 03:32:43 user nova-compute[75006]: </domain>
Nov 27 03:32:43 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:32:43 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance destroyed successfully.
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:32:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] No VIF found with MAC fa:16:3e:64:05:65, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:32:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-8b345967-856c-48a4-821e-fa2f8ba203f9 req-b7b6e740-62bb-4231-ae34-8682d7ef17ba service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8b345967-856c-48a4-821e-fa2f8ba203f9 req-b7b6e740-62bb-4231-ae34-8682d7ef17ba service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8b345967-856c-48a4-821e-fa2f8ba203f9 req-b7b6e740-62bb-4231-ae34-8682d7ef17ba service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8b345967-856c-48a4-821e-fa2f8ba203f9 req-b7b6e740-62bb-4231-ae34-8682d7ef17ba service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-8b345967-856c-48a4-821e-fa2f8ba203f9 req-b7b6e740-62bb-4231-ae34-8682d7ef17ba service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:44 user nova-compute[75006]: WARNING nova.compute.manager [req-8b345967-856c-48a4-821e-fa2f8ba203f9 req-b7b6e740-62bb-4231-ae34-8682d7ef17ba service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state active and task_state rescuing.
Nov 27 03:32:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:46 user nova-compute[75006]: WARNING nova.compute.manager [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state active and task_state rescuing.
Nov 27 03:32:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:32:46 user nova-compute[75006]: WARNING nova.compute.manager [req-fe1a64be-9aaf-47f3-ae00-54caa2c28675 req-97827748-36c4-4b36-af1e-30a119f2c8e2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state active and task_state rescuing.
Nov 27 03:32:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-47591221-d90e-43a2-9152-9fcdcd424cfd tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:32:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:54 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:32:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:32:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:32:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:32:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:32:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updating instance_info_cache with network_info: [{"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-cb58f809-30cb-487b-b608-f2c7973d2225" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:32:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:32:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:33:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:33:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7278MB free_disk=25.01120376586914GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6990b476-cfd5-43c0-a295-5ee42393d35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6b291b73-1b23-415a-ae61-f994d6e33d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 1556b696-96e5-4cd6-9246-3673235d47fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:33:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:33:04 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:33:04 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:33:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:33:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-d98b1b9a-aa3d-4fa0-a4e7-da11f23e95fa req-0a50da34-758c-4dd2-b036-4ce53c82e52f service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-d98b1b9a-aa3d-4fa0-a4e7-da11f23e95fa req-0a50da34-758c-4dd2-b036-4ce53c82e52f service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing instance network info cache due to event network-changed-e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d98b1b9a-aa3d-4fa0-a4e7-da11f23e95fa req-0a50da34-758c-4dd2-b036-4ce53c82e52f service nova] Acquiring lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d98b1b9a-aa3d-4fa0-a4e7-da11f23e95fa req-0a50da34-758c-4dd2-b036-4ce53c82e52f service nova] Acquired lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-d98b1b9a-aa3d-4fa0-a4e7-da11f23e95fa req-0a50da34-758c-4dd2-b036-4ce53c82e52f service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Refreshing network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:12 user nova-compute[75006]: INFO nova.compute.manager [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Terminating instance
Nov 27 03:33:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:33:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-d98b1b9a-aa3d-4fa0-a4e7-da11f23e95fa req-0a50da34-758c-4dd2-b036-4ce53c82e52f service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updated VIF entry in instance network info cache for port e5137b18-6b9a-4ee0-af15-45581ed243c2. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.network.neutron [req-d98b1b9a-aa3d-4fa0-a4e7-da11f23e95fa req-0a50da34-758c-4dd2-b036-4ce53c82e52f service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [{"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d98b1b9a-aa3d-4fa0-a4e7-da11f23e95fa req-0a50da34-758c-4dd2-b036-4ce53c82e52f service nova] Releasing lock "refresh_cache-67512cf7-e06d-406e-ad8b-fcfd6fbbb472" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Instance destroyed successfully.
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.objects.instance [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lazy-loading 'resources' on Instance uuid 67512cf7-e06d-406e-ad8b-fcfd6fbbb472 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1350526478',display_name='tempest-TestShelveInstance-server-1350526478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1350526478',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlQSNuDrUjejO0Gh0EnVAdJHDpXJSubJx7mrtBILqMgeIwPMdBqlx3c/VqejDgOvDMNN3L0QqSQDY4OZx8knM+Umllig6NVhbmKGxLaxDgBM3MYpnCYIWlWsHwT/gfSZA==',key_name='tempest-TestShelveInstance-800573928',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:31:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4cdd7f6a9244a1d825cda5b92610432',ramdisk_id='',reservation_id='r-oh2aae0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-313467041',owner_user_name='tempest-TestShelveInstance-313467041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:31:36Z,user_data=None,user_id='24fcf1d84af04fa09278a318510fe6fd',uuid=67512cf7-e06d-406e-ad8b-fcfd6fbbb472,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converting VIF {"id": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "address": "fa:16:3e:4c:d6:07", "network": {"id": "c97db4c6-4049-4e97-993d-8eaa030f7af7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088609698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4cdd7f6a9244a1d825cda5b92610432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5137b18-6b", "ovs_interfaceid": "e5137b18-6b9a-4ee0-af15-45581ed243c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_vif [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5137b18-6b, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70cfe125-9d8c-4c87-b5aa-c102cb11bef6) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:13 user nova-compute[75006]: INFO os_vif [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:d6:07,bridge_name='br-int',has_traffic_filtering=True,id=e5137b18-6b9a-4ee0-af15-45581ed243c2,network=Network(c97db4c6-4049-4e97-993d-8eaa030f7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5137b18-6b')
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJijpCdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:33:13 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeb6f46-543f-4284-816f-665460c3a88c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:33:13 user nova-compute[75006]: No targets found.
Nov 27 03:33:13 user nova-compute[75006]: iSNS:
Nov 27 03:33:13 user nova-compute[75006]: No targets found.
Nov 27 03:33:13 user nova-compute[75006]: STATIC:
Nov 27 03:33:13 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:33:13 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:33:13 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:33:13 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0
Nov 27 03:33:13 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:33:13 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:33:13 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5
Nov 27 03:33:13 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:33:13 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:33:13 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c
Nov 27 03:33:13 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:33:13 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:33:13 user nova-compute[75006]: FIRMWARE:
Nov 27 03:33:13 user nova-compute[75006]: No targets found.
Nov 27 03:33:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:33:13 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:33:13 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d76a79-f630-4f11-aef2-18fd628c8fb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4654c841-276c-4b5b-afc4-bd20fbdd72fc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:33:13 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:33:13 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:33:13 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:33:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:33:13 user nova-compute[75006]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 (non-flash)
Nov 27 03:33:13 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:33:13 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:33:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c2cc1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87dc536-e356-40d8-8ae5-07aa61ba879b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3f354e-00d0-4b34-9612-a93977f5aa0d]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1668e97-17a9-43bc-a062-4dc25777937d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b7da4e-0178-4a36-8678-0ba6409de09f]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23962346135393162', '/dev/disk/by-id/scsi-1SCST_BIO6edd56ed-9b4a591b0997b2f7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6edd56ed') {{(pid=85775) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cac1fa6-2997-45f6-8a32-e674ec39abb7]: (4, None) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc34133-f711-46a8-b52c-96ab0e2e56e8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ebb2ef-cd56-4274-ac37-6048dbe043db]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260]
Nov 27 03:33:13 user nova-compute[75006]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0, portal: 172.16.0.220,3260] successful.
Nov 27 03:33:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ebe4e2-c2e7-49ef-a1e6-439be2b91f16]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] <== disconnect_volume: return (303ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:33:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Deleting instance files /opt/stack/data/nova/instances/67512cf7-e06d-406e-ad8b-fcfd6fbbb472_del
Nov 27 03:33:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Deletion of /opt/stack/data/nova/instances/67512cf7-e06d-406e-ad8b-fcfd6fbbb472_del complete
Nov 27 03:33:13 user nova-compute[75006]: INFO nova.compute.manager [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 27 03:33:13 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:33:13 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:33:14 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Took 0.55 seconds to deallocate network for instance.
Nov 27 03:33:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-8148e479-5e86-4107-ab77-c5fdc39523e8 req-9f524ea3-6e23-431b-a254-bedb3fa22476 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-deleted-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-unplugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] No waiting events found dispatching network-vif-unplugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-unplugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] Acquiring lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] No waiting events found dispatching network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:33:14 user nova-compute[75006]: WARNING nova.compute.manager [req-fd4f00c2-d85c-406d-93e7-a2d821f17a02 req-883835e7-8a9c-48c7-ba43-29c6bf6b49d3 service nova] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Received unexpected event network-vif-plugged-e5137b18-6b9a-4ee0-af15-45581ed243c2 for instance with vm_state active and task_state deleting.
Nov 27 03:33:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:15 user nova-compute[75006]: INFO nova.compute.manager [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Took 0.76 seconds to detach 1 volumes for instance.
Nov 27 03:33:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] [instance: 67512cf7-e06d-406e-ad8b-fcfd6fbbb472] Deleting volume: 2ae6deb1-eb3e-4ecf-81d6-86c36412cee0 {{(pid=75006) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 03:33:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:15 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:33:15 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:33:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:15 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Deleted allocations for instance 67512cf7-e06d-406e-ad8b-fcfd6fbbb472
Nov 27 03:33:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fff363cb-2a27-4e85-9f9f-9bb541cd4a23 tempest-TestShelveInstance-313467041 tempest-TestShelveInstance-313467041-project-member] Lock "67512cf7-e06d-406e-ad8b-fcfd6fbbb472" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.214s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:19 user nova-compute[75006]: INFO nova.compute.manager [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Detaching volume 11dbf17c-a923-4485-983e-6636832a244c
Nov 27 03:33:19 user nova-compute[75006]: INFO nova.virt.block_device [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Attempting to driver detach volume 11dbf17c-a923-4485-983e-6636832a244c from mountpoint /dev/vdc
Nov 27 03:33:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Attempting to detach device vdc from instance 1556b696-96e5-4cd6-9246-3673235d47fc from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:33:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:33:19 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:33:19 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:33:19 user nova-compute[75006]:   <target dev="vdc" bus="virtio"/>
Nov 27 03:33:19 user nova-compute[75006]:   <serial>11dbf17c-a923-4485-983e-6636832a244c</serial>
Nov 27 03:33:19 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 03:33:19 user nova-compute[75006]: </disk>
Nov 27 03:33:19 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:33:19 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully detached device vdc from instance 1556b696-96e5-4cd6-9246-3673235d47fc from the persistent domain config.
Nov 27 03:33:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1556b696-96e5-4cd6-9246-3673235d47fc from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:33:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:33:19 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:33:19 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:33:19 user nova-compute[75006]:   <target dev="vdc" bus="virtio"/>
Nov 27 03:33:19 user nova-compute[75006]:   <serial>11dbf17c-a923-4485-983e-6636832a244c</serial>
Nov 27 03:33:19 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 03:33:19 user nova-compute[75006]: </disk>
Nov 27 03:33:19 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:33:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:33:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:39 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1556b696-96e5-4cd6-9246-3673235d47fc is timed out.
Nov 27 03:33:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully detached device vdc from instance 1556b696-96e5-4cd6-9246-3673235d47fc from the live domain config.
Nov 27 03:33:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yoqZdzfa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:33:39 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a981a8-2bbc-4745-847d-d4584b6470de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:33:39 user nova-compute[75006]: No targets found.
Nov 27 03:33:39 user nova-compute[75006]: iSNS:
Nov 27 03:33:39 user nova-compute[75006]: No targets found.
Nov 27 03:33:39 user nova-compute[75006]: STATIC:
Nov 27 03:33:39 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:33:39 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:33:39 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:33:39 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5
Nov 27 03:33:39 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:33:39 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:33:39 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c
Nov 27 03:33:39 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:33:39 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:33:39 user nova-compute[75006]: FIRMWARE:
Nov 27 03:33:39 user nova-compute[75006]: No targets found.
Nov 27 03:33:39 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:33:39 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:33:39 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8030f81-e7c1-44f0-b186-d180717d31f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faa9cc9-dd7d-4a79-9ee3-16de30fec121]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:33:39 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:33:39 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:33:39 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:33:39 user nova-compute[75006]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c (non-flash)
Nov 27 03:33:39 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:33:39 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c1429e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d0b7d6-1087-457a-be41-a2785130f4d7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a239b81d-5bab-4805-b23c-a16001359176]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7981d9-f9bd-4d91-99d2-cf87ea281634]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b68dd3-7c2f-4421-b4df-4c011c02026a]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33faf0-1fd9-46ed-a074-e42fc7776753]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:33:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ed7737-fa47-478d-ab85-308212b80ebb]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c, portal: 172.16.0.220,3260]
Nov 27 03:33:40 user nova-compute[75006]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c, portal: 172.16.0.220,3260] successful.
Nov 27 03:33:40 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dbf17c-a923-4485-983e-6636832a244c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8be275-7171-4891-bf8b-ce38c7926f3d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] <== disconnect_volume: return (282ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:33:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "54e46dc7-4d71-4720-9906-270ab0c872e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:33:41 user nova-compute[75006]: INFO nova.compute.claims [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Claim successful on node user
Nov 27 03:33:41 user nova-compute[75006]: DEBUG nova.objects.instance [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'flavor' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-26be1d8e-c54b-4365-bb47-da70037fe238 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.418s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:33:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:33:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG nova.policy [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bdc7ee98a95432d96679fc697b7d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bbdcea84574886bbea67eefc84dca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:33:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Creating image(s)
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "/opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "/opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "/opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.190s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk 1073741824" returned: 0 in 0.106s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Successfully created port: 6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Cannot resize image /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Ensure instance console log exists: /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Successfully updated port: 6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquired lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-d77e73d8-df97-44c9-aefc-087b1b3e2e23 req-7057acce-220d-49b5-81b5-96c4ab00c7c9 service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received event network-changed-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-d77e73d8-df97-44c9-aefc-087b1b3e2e23 req-7057acce-220d-49b5-81b5-96c4ab00c7c9 service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Refreshing instance network info cache due to event network-changed-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d77e73d8-df97-44c9-aefc-087b1b3e2e23 req-7057acce-220d-49b5-81b5-96c4ab00c7c9 service nova] Acquiring lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Updating instance_info_cache with network_info: [{"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Releasing lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Instance network_info: |[{"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d77e73d8-df97-44c9-aefc-087b1b3e2e23 req-7057acce-220d-49b5-81b5-96c4ab00c7c9 service nova] Acquired lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.neutron [req-d77e73d8-df97-44c9-aefc-087b1b3e2e23 req-7057acce-220d-49b5-81b5-96c4ab00c7c9 service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Refreshing network info cache for port 6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Start _get_guest_xml network_info=[{"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:33:43 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:33:43 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2138748162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2138748162',id=38,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-73orpp5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:33:42Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=54e46dc7-4d71-4720-9906-270ab0c872e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:6b:26,bridge_name='br-int',has_traffic_filtering=True,id=6d706da3-1b94-45ed-8c43-cc71c9fd5ff3,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d706da3-1b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'pci_devices' on Instance uuid 54e46dc7-4d71-4720-9906-270ab0c872e7 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:33:43 user nova-compute[75006]:   <uuid>54e46dc7-4d71-4720-9906-270ab0c872e7</uuid>
Nov 27 03:33:43 user nova-compute[75006]:   <name>instance-00000026</name>
Nov 27 03:33:43 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:33:43 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:33:43 user nova-compute[75006]:   <metadata>
Nov 27 03:33:43 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:33:43 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:33:43 user nova-compute[75006]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2138748162</nova:name>
Nov 27 03:33:43 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:33:43</nova:creationTime>
Nov 27 03:33:43 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:33:43 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:33:43 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:33:43 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:33:43 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:33:43 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:33:43 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:33:43 user nova-compute[75006]:       <nova:owner>
Nov 27 03:33:43 user nova-compute[75006]:         <nova:user uuid="7bdc7ee98a95432d96679fc697b7d61d">tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member</nova:user>
Nov 27 03:33:43 user nova-compute[75006]:         <nova:project uuid="03bbdcea84574886bbea67eefc84dca0">tempest-ServerBootFromVolumeStableRescueTest-2135085811</nova:project>
Nov 27 03:33:43 user nova-compute[75006]:       </nova:owner>
Nov 27 03:33:43 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:33:43 user nova-compute[75006]:       <nova:ports>
Nov 27 03:33:43 user nova-compute[75006]:         <nova:port uuid="6d706da3-1b94-45ed-8c43-cc71c9fd5ff3">
Nov 27 03:33:43 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 03:33:43 user nova-compute[75006]:         </nova:port>
Nov 27 03:33:43 user nova-compute[75006]:       </nova:ports>
Nov 27 03:33:43 user nova-compute[75006]:     </nova:instance>
Nov 27 03:33:43 user nova-compute[75006]:   </metadata>
Nov 27 03:33:43 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:33:43 user nova-compute[75006]:     <system>
Nov 27 03:33:43 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:33:43 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:33:43 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:33:43 user nova-compute[75006]:       <entry name="serial">54e46dc7-4d71-4720-9906-270ab0c872e7</entry>
Nov 27 03:33:43 user nova-compute[75006]:       <entry name="uuid">54e46dc7-4d71-4720-9906-270ab0c872e7</entry>
Nov 27 03:33:43 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:33:43 user nova-compute[75006]:     </system>
Nov 27 03:33:43 user nova-compute[75006]:   </sysinfo>
Nov 27 03:33:43 user nova-compute[75006]:   <os>
Nov 27 03:33:43 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:33:43 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:33:43 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:33:43 user nova-compute[75006]:   </os>
Nov 27 03:33:43 user nova-compute[75006]:   <features>
Nov 27 03:33:43 user nova-compute[75006]:     <acpi/>
Nov 27 03:33:43 user nova-compute[75006]:     <apic/>
Nov 27 03:33:43 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:33:43 user nova-compute[75006]:   </features>
Nov 27 03:33:43 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:33:43 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:33:43 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:33:43 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:33:43 user nova-compute[75006]:   </clock>
Nov 27 03:33:43 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:33:43 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:33:43 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:33:43 user nova-compute[75006]:   </cpu>
Nov 27 03:33:43 user nova-compute[75006]:   <devices>
Nov 27 03:33:43 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:33:43 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:33:43 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk"/>
Nov 27 03:33:43 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:33:43 user nova-compute[75006]:     </disk>
Nov 27 03:33:43 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:33:43 user nova-compute[75006]:       <mac address="fa:16:3e:91:6b:26"/>
Nov 27 03:33:43 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:33:43 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:33:43 user nova-compute[75006]:       <target dev="tap6d706da3-1b"/>
Nov 27 03:33:43 user nova-compute[75006]:     </interface>
Nov 27 03:33:43 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:33:43 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/console.log" append="off"/>
Nov 27 03:33:43 user nova-compute[75006]:     </serial>
Nov 27 03:33:43 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:33:43 user nova-compute[75006]:     <video>
Nov 27 03:33:43 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:33:43 user nova-compute[75006]:     </video>
Nov 27 03:33:43 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:33:43 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:33:43 user nova-compute[75006]:     </rng>
Nov 27 03:33:43 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:33:43 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:33:43 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:33:43 user nova-compute[75006]:     </memballoon>
Nov 27 03:33:43 user nova-compute[75006]:   </devices>
Nov 27 03:33:43 user nova-compute[75006]: </domain>
Nov 27 03:33:43 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2138748162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2138748162',id=38,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-73orpp5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:33:42Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=54e46dc7-4d71-4720-9906-270ab0c872e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:6b:26,bridge_name='br-int',has_traffic_filtering=True,id=6d706da3-1b94-45ed-8c43-cc71c9fd5ff3,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d706da3-1b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG os_vif [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:6b:26,bridge_name='br-int',has_traffic_filtering=True,id=6d706da3-1b94-45ed-8c43-cc71c9fd5ff3,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d706da3-1b') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a9072b6-2f1a-5663-8dfa-d0bcf1e3068c', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d706da3-1b, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d706da3-1b, col_values=(('qos', UUID('544f411b-9392-40e1-9dc4-b3db4c98fb0a')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d706da3-1b, col_values=(('external_ids', {'iface-id': '6d706da3-1b94-45ed-8c43-cc71c9fd5ff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:6b:26', 'vm-uuid': '54e46dc7-4d71-4720-9906-270ab0c872e7'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:33:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:43 user nova-compute[75006]: INFO os_vif [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:6b:26,bridge_name='br-int',has_traffic_filtering=True,id=6d706da3-1b94-45ed-8c43-cc71c9fd5ff3,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d706da3-1b')
Nov 27 03:33:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:33:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No VIF found with MAC fa:16:3e:91:6b:26, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:33:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-d77e73d8-df97-44c9-aefc-087b1b3e2e23 req-7057acce-220d-49b5-81b5-96c4ab00c7c9 service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Updated VIF entry in instance network info cache for port 6d706da3-1b94-45ed-8c43-cc71c9fd5ff3. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:33:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-d77e73d8-df97-44c9-aefc-087b1b3e2e23 req-7057acce-220d-49b5-81b5-96c4ab00c7c9 service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Updating instance_info_cache with network_info: [{"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:33:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d77e73d8-df97-44c9-aefc-087b1b3e2e23 req-7057acce-220d-49b5-81b5-96c4ab00c7c9 service nova] Releasing lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-e705dfb9-6f1a-49d8-b6c4-3d747de3cb4a req-200413d1-1f2f-4ce5-a416-786d170c29bf service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received event network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e705dfb9-6f1a-49d8-b6c4-3d747de3cb4a req-200413d1-1f2f-4ce5-a416-786d170c29bf service nova] Acquiring lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e705dfb9-6f1a-49d8-b6c4-3d747de3cb4a req-200413d1-1f2f-4ce5-a416-786d170c29bf service nova] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e705dfb9-6f1a-49d8-b6c4-3d747de3cb4a req-200413d1-1f2f-4ce5-a416-786d170c29bf service nova] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-e705dfb9-6f1a-49d8-b6c4-3d747de3cb4a req-200413d1-1f2f-4ce5-a416-786d170c29bf service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] No waiting events found dispatching network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:33:45 user nova-compute[75006]: WARNING nova.compute.manager [req-e705dfb9-6f1a-49d8-b6c4-3d747de3cb4a req-200413d1-1f2f-4ce5-a416-786d170c29bf service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received unexpected event network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 for instance with vm_state building and task_state spawning.
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:33:47 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Instance spawned successfully.
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:33:47 user nova-compute[75006]: INFO nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:33:47 user nova-compute[75006]: INFO nova.compute.manager [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Took 6.30 seconds to build instance.
Nov 27 03:33:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2d384ce-f795-467d-b923-206df20f44c3 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.453s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-e29642f0-69af-4a8b-beca-b6deeb0beeb1 req-f1d748bd-fdc1-4c02-801e-a64729355a5c service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received event network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e29642f0-69af-4a8b-beca-b6deeb0beeb1 req-f1d748bd-fdc1-4c02-801e-a64729355a5c service nova] Acquiring lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e29642f0-69af-4a8b-beca-b6deeb0beeb1 req-f1d748bd-fdc1-4c02-801e-a64729355a5c service nova] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e29642f0-69af-4a8b-beca-b6deeb0beeb1 req-f1d748bd-fdc1-4c02-801e-a64729355a5c service nova] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-e29642f0-69af-4a8b-beca-b6deeb0beeb1 req-f1d748bd-fdc1-4c02-801e-a64729355a5c service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] No waiting events found dispatching network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:33:47 user nova-compute[75006]: WARNING nova.compute.manager [req-e29642f0-69af-4a8b-beca-b6deeb0beeb1 req-f1d748bd-fdc1-4c02-801e-a64729355a5c service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received unexpected event network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 for instance with vm_state active and task_state None.
Nov 27 03:33:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:51 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:53 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:53 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:33:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:33:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:33:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:33:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:33:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:33:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:33:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updating instance_info_cache with network_info: [{"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:33:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:34:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:34:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:34:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7399MB free_disk=24.981433868408203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:34:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6990b476-cfd5-43c0-a295-5ee42393d35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6b291b73-1b23-415a-ae61-f994d6e33d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 1556b696-96e5-4cd6-9246-3673235d47fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.008s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:05 user nova-compute[75006]: INFO nova.compute.manager [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Terminating instance
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.987s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-547866a5-c13b-4b9b-bfb8-254d88e49740 req-cac9743f-9b5b-42c8-82d0-8267e62d7529 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received event network-vif-unplugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-547866a5-c13b-4b9b-bfb8-254d88e49740 req-cac9743f-9b5b-42c8-82d0-8267e62d7529 service nova] Acquiring lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-547866a5-c13b-4b9b-bfb8-254d88e49740 req-cac9743f-9b5b-42c8-82d0-8267e62d7529 service nova] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-547866a5-c13b-4b9b-bfb8-254d88e49740 req-cac9743f-9b5b-42c8-82d0-8267e62d7529 service nova] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-547866a5-c13b-4b9b-bfb8-254d88e49740 req-cac9743f-9b5b-42c8-82d0-8267e62d7529 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] No waiting events found dispatching network-vif-unplugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-547866a5-c13b-4b9b-bfb8-254d88e49740 req-cac9743f-9b5b-42c8-82d0-8267e62d7529 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received event network-vif-unplugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:34:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Instance destroyed successfully.
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.objects.instance [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lazy-loading 'resources' on Instance uuid 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-620499010',display_name='tempest-VolumesActionsTest-instance-620499010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-620499010',id=35,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:32:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67aa5c34f5fb4c07a266ad0aa94d26f7',ramdisk_id='',reservation_id='r-fis5x9wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-535517367',owner_user_name='tempest-VolumesActionsTest-535517367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:32:25Z,user_data=None,user_id='46cd9289539949318955d507a4b12276',uuid=6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converting VIF {"id": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "address": "fa:16:3e:44:85:0c", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf68afb12-40", "ovs_interfaceid": "f68afb12-40af-47ca-af4d-7afd9b3ec623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=f68afb12-40af-47ca-af4d-7afd9b3ec623,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf68afb12-40') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:05 user nova-compute[75006]: DEBUG os_vif [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=f68afb12-40af-47ca-af4d-7afd9b3ec623,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf68afb12-40') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf68afb12-40, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=043315bd-d477-43f0-b564-1fbba2798dd2) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:34:06 user nova-compute[75006]: INFO os_vif [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:85:0c,bridge_name='br-int',has_traffic_filtering=True,id=f68afb12-40af-47ca-af4d-7afd9b3ec623,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf68afb12-40')
Nov 27 03:34:06 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Deleting instance files /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab_del
Nov 27 03:34:06 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Deletion of /opt/stack/data/nova/instances/6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab_del complete
Nov 27 03:34:06 user nova-compute[75006]: INFO nova.compute.manager [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 27 03:34:06 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:34:06 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Took 0.49 seconds to deallocate network for instance.
Nov 27 03:34:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:07 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Deleted allocations for instance 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab
Nov 27 03:34:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-14cfc03c-eccb-4170-a0e2-0baccb348469 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG nova.compute.manager [req-2d2e6032-cb16-4c83-902f-4f9414d66f88 req-f0185512-b99f-419a-9bc1-9e04339cb771 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received event network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2d2e6032-cb16-4c83-902f-4f9414d66f88 req-f0185512-b99f-419a-9bc1-9e04339cb771 service nova] Acquiring lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2d2e6032-cb16-4c83-902f-4f9414d66f88 req-f0185512-b99f-419a-9bc1-9e04339cb771 service nova] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2d2e6032-cb16-4c83-902f-4f9414d66f88 req-f0185512-b99f-419a-9bc1-9e04339cb771 service nova] Lock "6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:07 user nova-compute[75006]: DEBUG nova.compute.manager [req-2d2e6032-cb16-4c83-902f-4f9414d66f88 req-f0185512-b99f-419a-9bc1-9e04339cb771 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] No waiting events found dispatching network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:07 user nova-compute[75006]: WARNING nova.compute.manager [req-2d2e6032-cb16-4c83-902f-4f9414d66f88 req-f0185512-b99f-419a-9bc1-9e04339cb771 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received unexpected event network-vif-plugged-f68afb12-40af-47ca-af4d-7afd9b3ec623 for instance with vm_state deleted and task_state None.
Nov 27 03:34:07 user nova-compute[75006]: DEBUG nova.compute.manager [req-2d2e6032-cb16-4c83-902f-4f9414d66f88 req-f0185512-b99f-419a-9bc1-9e04339cb771 service nova] [instance: 6aa1f38b-fc13-4aa8-a4ba-ea5e438c75ab] Received event network-vif-deleted-f68afb12-40af-47ca-af4d-7afd9b3ec623 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:08 user nova-compute[75006]: DEBUG nova.compute.manager [req-48bb2846-8c6e-4366-881b-08abf1882d1c req-946009b4-f224-4109-8809-a98b39b8af2d service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-changed-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:08 user nova-compute[75006]: DEBUG nova.compute.manager [req-48bb2846-8c6e-4366-881b-08abf1882d1c req-946009b4-f224-4109-8809-a98b39b8af2d service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Refreshing instance network info cache due to event network-changed-92f23dbf-0296-4f81-ba74-65e74dd75d0a. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:34:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-48bb2846-8c6e-4366-881b-08abf1882d1c req-946009b4-f224-4109-8809-a98b39b8af2d service nova] Acquiring lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:34:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-48bb2846-8c6e-4366-881b-08abf1882d1c req-946009b4-f224-4109-8809-a98b39b8af2d service nova] Acquired lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:34:08 user nova-compute[75006]: DEBUG nova.network.neutron [req-48bb2846-8c6e-4366-881b-08abf1882d1c req-946009b4-f224-4109-8809-a98b39b8af2d service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Refreshing network info cache for port 92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'flavor' on Instance uuid 80529600-0aed-4f2b-b8ce-f3bacaabcd0e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-48bb2846-8c6e-4366-881b-08abf1882d1c req-946009b4-f224-4109-8809-a98b39b8af2d service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updated VIF entry in instance network info cache for port 92f23dbf-0296-4f81-ba74-65e74dd75d0a. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-48bb2846-8c6e-4366-881b-08abf1882d1c req-946009b4-f224-4109-8809-a98b39b8af2d service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updating instance_info_cache with network_info: [{"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-48bb2846-8c6e-4366-881b-08abf1882d1c req-946009b4-f224-4109-8809-a98b39b8af2d service nova] Releasing lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:09 user nova-compute[75006]: INFO nova.compute.manager [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Attaching volume 229480ae-b634-4d37-9679-3ad1f9dae62f to /dev/vdb
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:09 user nova-compute[75006]: INFO nova.compute.manager [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Terminating instance
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG os_brick.utils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1de83c0-330f-409b-86c3-29e9e0a7aba8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[704cf976-9272-4917-a47c-1944c95fee26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b90d4b-9db7-4f9c-ba6a-a6a9399a0c99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced34bd6-65c7-4cc3-9638-8a39ec5e24fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:34:09 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d106ab-5714-44f1-9de5-0488ccfd7a2e]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG os_brick.utils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updating existing volume attachment record: 3cf978da-9cb7-4aaa-a15f-193b1693d1ba {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.objects.instance [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'flavor' on Instance uuid 5449b27f-2795-4ab6-a965-bdbbe9a9a59f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-668eb2f1-58e5-46ac-b21a-0e99afe72254 req-b837cab5-749e-47a5-a8d0-8d489780d46a service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-changed-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-668eb2f1-58e5-46ac-b21a-0e99afe72254 req-b837cab5-749e-47a5-a8d0-8d489780d46a service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Refreshing instance network info cache due to event network-changed-5cc2684b-5d2c-4b80-8516-3838a2b54771. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-668eb2f1-58e5-46ac-b21a-0e99afe72254 req-b837cab5-749e-47a5-a8d0-8d489780d46a service nova] Acquiring lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-668eb2f1-58e5-46ac-b21a-0e99afe72254 req-b837cab5-749e-47a5-a8d0-8d489780d46a service nova] Acquired lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:34:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-668eb2f1-58e5-46ac-b21a-0e99afe72254 req-b837cab5-749e-47a5-a8d0-8d489780d46a service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Refreshing network info cache for port 5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:10 user nova-compute[75006]: INFO nova.compute.manager [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Attaching volume 24312365-c85b-476a-820e-8b1bbe2dfa47 to /dev/vdb
Nov 27 03:34:10 user nova-compute[75006]: DEBUG os_brick.utils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd257f3-d132-46af-a812-74572ba6f67c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e33d7d-13ba-4bf7-9d87-a45d6db525de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fb26bc-0327-4f5f-b710-97ec41c0f3ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[59669700-8838-4701-b5ad-50d8b3858476]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Instance destroyed successfully.
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'resources' on Instance uuid 1556b696-96e5-4cd6-9246-3673235d47fc {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:34:10 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a0baf9-57ab-42e6-a99a-598d19e404dc]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG os_brick.utils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Updating existing volume attachment record: 4233dae2-cacf-4d34-8c72-9349bc1d78a4 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:27:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-663731875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-663731875',id=27,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2c2VFlgBpGIwKezBrl602UeEXzR+Dbjd2U7k8O4/faonkz0iODXczWyuPBBZpYsA9dCmpvs95jW1H4duBhY91uajCGryA/XBUhb+0JFKyJbhTZ+vCbRL5JtWceoCcMUw==',key_name='tempest-keypair-720199553',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:31:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-awbkwbnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=1556b696-96e5-4cd6-9246-3673235d47fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "address": "fa:16:3e:dd:8b:c2", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391a7fa7-53", "ovs_interfaceid": "391a7fa7-53fe-41fc-a6c1-e49603ea7c96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG os_vif [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391a7fa7-53, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d973c9e-511d-45f6-81f4-7ecb27d89cf7) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:10 user nova-compute[75006]: INFO os_vif [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8b:c2,bridge_name='br-int',has_traffic_filtering=True,id=391a7fa7-53fe-41fc-a6c1-e49603ea7c96,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391a7fa7-53')
Nov 27 03:34:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Deleting instance files /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc_del
Nov 27 03:34:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Deletion of /opt/stack/data/nova/instances/1556b696-96e5-4cd6-9246-3673235d47fc_del complete
Nov 27 03:34:10 user nova-compute[75006]: INFO nova.compute.manager [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-668eb2f1-58e5-46ac-b21a-0e99afe72254 req-b837cab5-749e-47a5-a8d0-8d489780d46a service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Updated VIF entry in instance network info cache for port 5cc2684b-5d2c-4b80-8516-3838a2b54771. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-668eb2f1-58e5-46ac-b21a-0e99afe72254 req-b837cab5-749e-47a5-a8d0-8d489780d46a service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Updating instance_info_cache with network_info: [{"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-668eb2f1-58e5-46ac-b21a-0e99afe72254 req-b837cab5-749e-47a5-a8d0-8d489780d46a service nova] Releasing lock "refresh_cache-5449b27f-2795-4ab6-a965-bdbbe9a9a59f" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-unplugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] Acquiring lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] Lock "1556b696-96e5-4cd6-9246-3673235d47fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] No waiting events found dispatching network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:10 user nova-compute[75006]: WARNING nova.compute.manager [req-c29e36fa-2f82-40c0-a199-2efbfaf6021a req-4d630427-2200-45b3-8ae9-9c186d478a25 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received unexpected event network-vif-plugged-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 for instance with vm_state active and task_state deleting.
Nov 27 03:34:11 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:34:12 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Took 1.37 seconds to deallocate network for instance.
Nov 27 03:34:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-647a90ff-ae03-4df3-97c4-c21bcf234f12 req-06ac6a48-14cc-4bd8-aa0b-de3ef9a39982 service nova] [instance: 1556b696-96e5-4cd6-9246-3673235d47fc] Received event network-vif-deleted-391a7fa7-53fe-41fc-a6c1-e49603ea7c96 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:12 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:34:12 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:34:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:12 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Deleted allocations for instance 1556b696-96e5-4cd6-9246-3673235d47fc
Nov 27 03:34:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-baf3bb04-252b-4c7e-8829-76b2c5c4908e tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "1556b696-96e5-4cd6-9246-3673235d47fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHQniPAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:16 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:16 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:16 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fae3af-588f-4afd-b1b7-9c8905866057]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:34:16 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[31983e05-7766-4677-b251-7171874dc4ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f] added
Nov 27 03:34:16 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce39501-9000-4970-ba4e-96d4b6d2473c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398fa30-3dbb-4ebe-ae71-973094e97344]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHQniPAs {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CHQniPAs" returned: 0 in 0.042s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1c9769-f26c-47ff-93ba-50b02ee9531d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CHQniPAs'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab6884c-995b-4977-8ede-4b7ec93d3f2a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f14357-dd28-4c18-ad83-a0f0f675b1b3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:16 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:16 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:16 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:16 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c782e62-d11b-4bba-b61b-f20d4158ab50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f, portal: 172.16.0.220,3260]
Nov 27 03:34:16 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f, portal: 172.16.0.220,3260] successful.
Nov 27 03:34:16 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc29cf-ead1-414f-a923-326b038d77c9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7774990-2238-4534-a5ca-e4aa453800d2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:17 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:17 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:17 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:17 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:17 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:17 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9c0582-ddac-4eda-b864-c801e615469a]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHQniPAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJnXuKhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:17 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:34:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26335323866313934', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335323866313934', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.976s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:18 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:18 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'flavor' on Instance uuid 80529600-0aed-4f2b-b8ce-f3bacaabcd0e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[be803070-f1d9-4abb-bcc1-d16db75e3189]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:34:18 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:34:18 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:34:18 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:34:18 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:34:18 user nova-compute[75006]:   <serial>229480ae-b634-4d37-9679-3ad1f9dae62f</serial>
Nov 27 03:34:18 user nova-compute[75006]: </disk>
Nov 27 03:34:18 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4351555e-4b95-41c1-afb2-6d9b9a297c71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47] added
Nov 27 03:34:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fc1e75-1894-4cbd-8c97-9e000988df8d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[309302df-3ae6-447a-84bc-7f982e979f60]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJnXuKhQ {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJnXuKhQ" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d169fc8-c786-4e01-b1b1-be80a1d7b490]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IJnXuKhQ'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed81894-e518-44ec-b79e-2aa320752b40]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c87d78-e6f3-4f74-bc0d-4430d52c305a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec835a6-3edb-4d6f-acfa-772248a0b9ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260]
Nov 27 03:34:18 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260] successful.
Nov 27 03:34:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[df28a77f-8689-4ca4-b3dd-8ac0b29ddb58]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3190ad9-eecd-48a4-997c-bb6ee5b6970a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:18 user nova-compute[75006]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae7b277-ed33-4ba9-9774-1ffbbded0008]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJnXuKhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] No VIF found with MAC fa:16:3e:44:bc:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:34:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b2c5841d-6998-4e27-8a18-5e2871aa01fa tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.164s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== connect_volume: return (2364ms) {'type': 'block', 'scsi_wwn': '23263383962323566', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263383962323566', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:34:19 user nova-compute[75006]: DEBUG nova.objects.instance [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'flavor' on Instance uuid 5449b27f-2795-4ab6-a965-bdbbe9a9a59f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:34:19 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:34:19 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:34:19 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:34:19 user nova-compute[75006]:   <serial>24312365-c85b-476a-820e-8b1bbe2dfa47</serial>
Nov 27 03:34:19 user nova-compute[75006]: </disk>
Nov 27 03:34:19 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:34:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:34:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:34:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No VIF found with MAC fa:16:3e:e6:23:80, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:34:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-85c488bd-c32d-44ec-b544-351b0bbb130a tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.933s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:20 user nova-compute[75006]: INFO nova.compute.manager [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Detaching volume 229480ae-b634-4d37-9679-3ad1f9dae62f
Nov 27 03:34:20 user nova-compute[75006]: INFO nova.virt.block_device [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Attempting to driver detach volume 229480ae-b634-4d37-9679-3ad1f9dae62f from mountpoint /dev/vdb
Nov 27 03:34:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Attempting to detach device vdb from instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:34:21 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:34:21 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:34:21 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:34:21 user nova-compute[75006]:   <serial>229480ae-b634-4d37-9679-3ad1f9dae62f</serial>
Nov 27 03:34:21 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:34:21 user nova-compute[75006]: </disk>
Nov 27 03:34:21 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:34:21 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Successfully detached device vdb from instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e from the persistent domain config.
Nov 27 03:34:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:34:21 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:34:21 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:34:21 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:34:21 user nova-compute[75006]:   <serial>229480ae-b634-4d37-9679-3ad1f9dae62f</serial>
Nov 27 03:34:21 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:34:21 user nova-compute[75006]: </disk>
Nov 27 03:34:21 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:34:21 user nova-compute[75006]: INFO nova.compute.manager [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Rebuilding instance
Nov 27 03:34:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-b3cda313-3ea9-4c25-be58-06b6c1122a74 req-e61af9ff-1dc6-4346-8cf6-fcfc5115db2b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-unplugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b3cda313-3ea9-4c25-be58-06b6c1122a74 req-e61af9ff-1dc6-4346-8cf6-fcfc5115db2b service nova] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b3cda313-3ea9-4c25-be58-06b6c1122a74 req-e61af9ff-1dc6-4346-8cf6-fcfc5115db2b service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b3cda313-3ea9-4c25-be58-06b6c1122a74 req-e61af9ff-1dc6-4346-8cf6-fcfc5115db2b service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-b3cda313-3ea9-4c25-be58-06b6c1122a74 req-e61af9ff-1dc6-4346-8cf6-fcfc5115db2b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] No waiting events found dispatching network-vif-unplugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:21 user nova-compute[75006]: WARNING nova.compute.manager [req-b3cda313-3ea9-4c25-be58-06b6c1122a74 req-e61af9ff-1dc6-4346-8cf6-fcfc5115db2b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received unexpected event network-vif-unplugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 for instance with vm_state active and task_state rebuilding.
Nov 27 03:34:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance destroyed successfully.
Nov 27 03:34:22 user nova-compute[75006]: INFO nova.compute.manager [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Detaching volume 24312365-c85b-476a-820e-8b1bbe2dfa47
Nov 27 03:34:22 user nova-compute[75006]: INFO nova.virt.block_device [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Attempting to driver detach volume 24312365-c85b-476a-820e-8b1bbe2dfa47 from mountpoint /dev/vdb
Nov 27 03:34:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Attempting to detach device vdb from instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:34:22 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:34:22 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:34:22 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:34:22 user nova-compute[75006]:   <serial>24312365-c85b-476a-820e-8b1bbe2dfa47</serial>
Nov 27 03:34:22 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:34:22 user nova-compute[75006]: </disk>
Nov 27 03:34:22 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:34:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully detached device vdb from instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f from the persistent domain config.
Nov 27 03:34:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJnXuKhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:22 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdd2549-779b-40f0-83dd-feb8247fd203]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:34:22 user nova-compute[75006]: No targets found.
Nov 27 03:34:22 user nova-compute[75006]: iSNS:
Nov 27 03:34:22 user nova-compute[75006]: No targets found.
Nov 27 03:34:22 user nova-compute[75006]: STATIC:
Nov 27 03:34:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f
Nov 27 03:34:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47
Nov 27 03:34:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:34:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:22 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5
Nov 27 03:34:22 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:22 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:22 user nova-compute[75006]: FIRMWARE:
Nov 27 03:34:22 user nova-compute[75006]: No targets found.
Nov 27 03:34:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:34:22 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:34:22 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[73666c3a-8194-4f1d-a6b7-d94fc4a59a7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d984c7c-257e-4c06-a94a-3d1b6445f189]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:22 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:22 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:22 user nova-compute[75006]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:22 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:22 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:22 user nova-compute[75006]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4247b4790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d46b04-39e2-4493-9f51-2f3d11d45d80]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e83a67-397d-493f-a18e-d2b569c4b0d6]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f8957f-42d9-4438-8e08-0a3edb3aa285]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5151e2bc-ecfd-45fc-b16a-0bb5620727ab]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fc7c50-ba48-4819-9af5-21aa55fefb3f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5523f6-bfd9-4f38-b34e-8e3d9ff2b3f1]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260]
Nov 27 03:34:22 user nova-compute[75006]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260] successful.
Nov 27 03:34:22 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8139f78f-62e7-4b7a-8b9d-be1dc76110ca]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== disconnect_volume: return (323ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:22 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:34:23 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance destroyed successfully.
Nov 27 03:34:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1685619028',display_name='tempest-ServerActionsTestOtherA-server-477263237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1685619028',id=37,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJFag2C77Tr4nhzxnc0tm5TpQOuqVamXe4nj4+Gk0KLzruErQ1k55s6Q8TO/stZcCT/wG7GOz0KVNgIVylEg5hU4pI8NSFtZskqPXMaykMNZszlWg7dAkBUiuxwzVsSCQ==',key_name='tempest-keypair-1724189151',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-zh8vdx7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:34:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=5449b27f-2795-4ab6-a965-bdbbe9a9a59f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_vif [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cc2684b-5d, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5d981fb-1f69-4727-9166-9bdfa0493809) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:23 user nova-compute[75006]: INFO os_vif [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d')
Nov 27 03:34:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJnXuKhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:23 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca6096a-296d-4979-9826-b78c86bf2c59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:34:23 user nova-compute[75006]: No targets found.
Nov 27 03:34:23 user nova-compute[75006]: iSNS:
Nov 27 03:34:23 user nova-compute[75006]: No targets found.
Nov 27 03:34:23 user nova-compute[75006]: STATIC:
Nov 27 03:34:23 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f
Nov 27 03:34:23 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:23 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:23 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:34:23 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:23 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:23 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5
Nov 27 03:34:23 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:23 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:23 user nova-compute[75006]: FIRMWARE:
Nov 27 03:34:23 user nova-compute[75006]: No targets found.
Nov 27 03:34:23 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:34:23 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:34:23 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[316dca65-e30e-4e10-9754-a469d5992875]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc24623a-e55b-4fdd-8627-225f2bc76baa]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:23 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:23 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:23 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:23 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:23 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:23 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c240820>, {}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Disconnecting from: [] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== disconnect_volume: return (95ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:34:23 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Deleting instance files /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f_del
Nov 27 03:34:23 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Deletion of /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f_del complete
Nov 27 03:34:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-abb392fe-eeed-49c8-bd5d-a21c6065c411 req-67641c5b-bd58-4faf-a502-1988286a3170 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-abb392fe-eeed-49c8-bd5d-a21c6065c411 req-67641c5b-bd58-4faf-a502-1988286a3170 service nova] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-abb392fe-eeed-49c8-bd5d-a21c6065c411 req-67641c5b-bd58-4faf-a502-1988286a3170 service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-abb392fe-eeed-49c8-bd5d-a21c6065c411 req-67641c5b-bd58-4faf-a502-1988286a3170 service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-abb392fe-eeed-49c8-bd5d-a21c6065c411 req-67641c5b-bd58-4faf-a502-1988286a3170 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] No waiting events found dispatching network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:23 user nova-compute[75006]: WARNING nova.compute.manager [req-abb392fe-eeed-49c8-bd5d-a21c6065c411 req-67641c5b-bd58-4faf-a502-1988286a3170 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received unexpected event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 for instance with vm_state active and task_state rebuilding.
Nov 27 03:34:23 user nova-compute[75006]: INFO nova.virt.block_device [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Booting with volume 24312365-c85b-476a-820e-8b1bbe2dfa47 at /dev/vdb
Nov 27 03:34:23 user nova-compute[75006]: DEBUG os_brick.utils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89c711e-0d34-40bd-b76a-1fdf85b087d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafd5021-c796-4af2-b818-d81c9db3b6a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff42d3c-53bd-4ed8-ad5c-677605813e78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed8f403-f49b-42b5-9951-ad96d846b478]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:34:24 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:34:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b50ce5-e73e-4876-90d1-fc01b4fa1dd4]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG os_brick.utils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:24 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Updating existing volume attachment record: 502d7e13-8ccc-44e3-982e-c80cee30fbd4 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:34:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:34:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Creating image(s)
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.112s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.193s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk 1073741824" returned: 0 in 0.051s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:31 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Cannot resize image /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Ensure instance console log exists: /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Start _get_guest_xml network_info=[{"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '502d7e13-8ccc-44e3-982e-c80cee30fbd4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJnXuKhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5449b27f-2795-4ab6-a965-bdbbe9a9a59f', 'attached_at': '', 'detached_at': '', 'volume_id': '24312365-c85b-476a-820e-8b1bbe2dfa47', 'serial': '24312365-c85b-476a-820e-8b1bbe2dfa47'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:34:32 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 03:34:32 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.objects.instance [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5449b27f-2795-4ab6-a965-bdbbe9a9a59f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJnXuKhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:32 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bec864-a2d1-416c-b59b-a75eb90ae704]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:34:32 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9edecf1-8abd-473b-89f3-b6f49ba0c605]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47] added
Nov 27 03:34:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e93965-7eb9-43b4-8e44-646fa6d3adc0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05ce14c-8348-4e2a-8fbd-28b5fa498664]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJnXuKhQ {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJnXuKhQ" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d8329e-e862-4975-9256-8eda5b1623b0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IJnXuKhQ'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[422c169d-155d-43a2-aa79-e16b8c7fa411]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85879c5-3aec-4fe7-8544-9e05c2b085e4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fc2ca-2c5b-4571-a669-2f89139bed95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260]
Nov 27 03:34:32 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260] successful.
Nov 27 03:34:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4549e4-40c7-43af-ad07-3ee45f4efa20]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: INFO nova.compute.manager [None req-5656537d-c66c-4e26-932e-73cf00b47f69 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Unrescuing
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5656537d-c66c-4e26-932e-73cf00b47f69 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5656537d-c66c-4e26-932e-73cf00b47f69 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquired lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG nova.network.neutron [None req-5656537d-c66c-4e26-932e-73cf00b47f69 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fbed1d-8a26-4ebe-b360-6799d5c54057]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:32 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3dac7-d390-4ec9-9ce4-28d8b0a02146]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:34:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJnXuKhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.network.neutron [None req-5656537d-c66c-4e26-932e-73cf00b47f69 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating instance_info_cache with network_info: [{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5656537d-c66c-4e26-932e-73cf00b47f69 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Releasing lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-5656537d-c66c-4e26-932e-73cf00b47f69 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'flavor' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23263383962323566', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263383962323566', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1685619028',display_name='tempest-ServerActionsTestOtherA-server-477263237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1685619028',id=37,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJFag2C77Tr4nhzxnc0tm5TpQOuqVamXe4nj4+Gk0KLzruErQ1k55s6Q8TO/stZcCT/wG7GOz0KVNgIVylEg5hU4pI8NSFtZskqPXMaykMNZszlWg7dAkBUiuxwzVsSCQ==',key_name='tempest-keypair-1724189151',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-zh8vdx7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:34:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=5449b27f-2795-4ab6-a965-bdbbe9a9a59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:34:33 user nova-compute[75006]:   <uuid>5449b27f-2795-4ab6-a965-bdbbe9a9a59f</uuid>
Nov 27 03:34:33 user nova-compute[75006]:   <name>instance-00000025</name>
Nov 27 03:34:33 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:34:33 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:34:33 user nova-compute[75006]:   <metadata>
Nov 27 03:34:33 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:34:33 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:34:33 user nova-compute[75006]:       <nova:name>tempest-ServerActionsTestOtherA-server-477263237</nova:name>
Nov 27 03:34:33 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:34:32</nova:creationTime>
Nov 27 03:34:33 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:34:33 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:34:33 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:34:33 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:34:33 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:34:33 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:34:33 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:34:33 user nova-compute[75006]:       <nova:owner>
Nov 27 03:34:33 user nova-compute[75006]:         <nova:user uuid="d4a327fa49cc468f8cbf23ae2d6d30d1">tempest-ServerActionsTestOtherA-507729530-project-member</nova:user>
Nov 27 03:34:33 user nova-compute[75006]:         <nova:project uuid="daa566d4c0fd4cbdbaf2b67ac2cea59a">tempest-ServerActionsTestOtherA-507729530</nova:project>
Nov 27 03:34:33 user nova-compute[75006]:       </nova:owner>
Nov 27 03:34:33 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:34:33 user nova-compute[75006]:       <nova:ports>
Nov 27 03:34:33 user nova-compute[75006]:         <nova:port uuid="5cc2684b-5d2c-4b80-8516-3838a2b54771">
Nov 27 03:34:33 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 03:34:33 user nova-compute[75006]:         </nova:port>
Nov 27 03:34:33 user nova-compute[75006]:       </nova:ports>
Nov 27 03:34:33 user nova-compute[75006]:     </nova:instance>
Nov 27 03:34:33 user nova-compute[75006]:   </metadata>
Nov 27 03:34:33 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:34:33 user nova-compute[75006]:     <system>
Nov 27 03:34:33 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:34:33 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:34:33 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:34:33 user nova-compute[75006]:       <entry name="serial">5449b27f-2795-4ab6-a965-bdbbe9a9a59f</entry>
Nov 27 03:34:33 user nova-compute[75006]:       <entry name="uuid">5449b27f-2795-4ab6-a965-bdbbe9a9a59f</entry>
Nov 27 03:34:33 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:34:33 user nova-compute[75006]:     </system>
Nov 27 03:34:33 user nova-compute[75006]:   </sysinfo>
Nov 27 03:34:33 user nova-compute[75006]:   <os>
Nov 27 03:34:33 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:34:33 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:34:33 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:34:33 user nova-compute[75006]:   </os>
Nov 27 03:34:33 user nova-compute[75006]:   <features>
Nov 27 03:34:33 user nova-compute[75006]:     <acpi/>
Nov 27 03:34:33 user nova-compute[75006]:     <apic/>
Nov 27 03:34:33 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:34:33 user nova-compute[75006]:   </features>
Nov 27 03:34:33 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:34:33 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:34:33 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:34:33 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:34:33 user nova-compute[75006]:   </clock>
Nov 27 03:34:33 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:34:33 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:34:33 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:34:33 user nova-compute[75006]:   </cpu>
Nov 27 03:34:33 user nova-compute[75006]:   <devices>
Nov 27 03:34:33 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:34:33 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:34:33 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk"/>
Nov 27 03:34:33 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:34:33 user nova-compute[75006]:     </disk>
Nov 27 03:34:33 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:34:33 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:34:33 user nova-compute[75006]:       <source dev="/dev/sde"/>
Nov 27 03:34:33 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:34:33 user nova-compute[75006]:       <serial>24312365-c85b-476a-820e-8b1bbe2dfa47</serial>
Nov 27 03:34:33 user nova-compute[75006]:     </disk>
Nov 27 03:34:33 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:34:33 user nova-compute[75006]:       <mac address="fa:16:3e:e6:23:80"/>
Nov 27 03:34:33 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:34:33 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:34:33 user nova-compute[75006]:       <target dev="tap5cc2684b-5d"/>
Nov 27 03:34:33 user nova-compute[75006]:     </interface>
Nov 27 03:34:33 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:34:33 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/console.log" append="off"/>
Nov 27 03:34:33 user nova-compute[75006]:     </serial>
Nov 27 03:34:33 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:34:33 user nova-compute[75006]:     <video>
Nov 27 03:34:33 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:34:33 user nova-compute[75006]:     </video>
Nov 27 03:34:33 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:34:33 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:34:33 user nova-compute[75006]:     </rng>
Nov 27 03:34:33 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:34:33 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:34:33 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:34:33 user nova-compute[75006]:     </memballoon>
Nov 27 03:34:33 user nova-compute[75006]:   </devices>
Nov 27 03:34:33 user nova-compute[75006]: </domain>
Nov 27 03:34:33 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1685619028',display_name='tempest-ServerActionsTestOtherA-server-477263237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1685619028',id=37,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJFag2C77Tr4nhzxnc0tm5TpQOuqVamXe4nj4+Gk0KLzruErQ1k55s6Q8TO/stZcCT/wG7GOz0KVNgIVylEg5hU4pI8NSFtZskqPXMaykMNZszlWg7dAkBUiuxwzVsSCQ==',key_name='tempest-keypair-1724189151',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-zh8vdx7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:34:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=5449b27f-2795-4ab6-a965-bdbbe9a9a59f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG os_vif [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f09402b-fc18-5165-996b-f20f02c6d4a2', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cc2684b-5d, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cc2684b-5d, col_values=(('qos', UUID('4e239be5-8772-4a5c-9d6b-aebca367599b')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cc2684b-5d, col_values=(('external_ids', {'iface-id': '5cc2684b-5d2c-4b80-8516-3838a2b54771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:23:80', 'vm-uuid': '5449b27f-2795-4ab6-a965-bdbbe9a9a59f'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:34:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:33 user nova-compute[75006]: INFO os_vif [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d')
Nov 27 03:34:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance destroyed successfully.
Nov 27 03:34:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:34:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:34:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No VIF found with MAC fa:16:3e:e6:23:80, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:34:34 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-aa32e4f8-99a5-4104-bb2a-baf6c2e111d4 req-751e3a74-1132-4b60-bd7a-37ad18848929 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa32e4f8-99a5-4104-bb2a-baf6c2e111d4 req-751e3a74-1132-4b60-bd7a-37ad18848929 service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa32e4f8-99a5-4104-bb2a-baf6c2e111d4 req-751e3a74-1132-4b60-bd7a-37ad18848929 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa32e4f8-99a5-4104-bb2a-baf6c2e111d4 req-751e3a74-1132-4b60-bd7a-37ad18848929 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-aa32e4f8-99a5-4104-bb2a-baf6c2e111d4 req-751e3a74-1132-4b60-bd7a-37ad18848929 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:34 user nova-compute[75006]: WARNING nova.compute.manager [req-aa32e4f8-99a5-4104-bb2a-baf6c2e111d4 req-751e3a74-1132-4b60-bd7a-37ad18848929 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:34:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-286e3939-213f-42c3-b2eb-6e7b56f2c08d req-ba8cf676-c129-4b3c-ac84-7d3c9c7f63fa service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-286e3939-213f-42c3-b2eb-6e7b56f2c08d req-ba8cf676-c129-4b3c-ac84-7d3c9c7f63fa service nova] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-286e3939-213f-42c3-b2eb-6e7b56f2c08d req-ba8cf676-c129-4b3c-ac84-7d3c9c7f63fa service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-286e3939-213f-42c3-b2eb-6e7b56f2c08d req-ba8cf676-c129-4b3c-ac84-7d3c9c7f63fa service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-286e3939-213f-42c3-b2eb-6e7b56f2c08d req-ba8cf676-c129-4b3c-ac84-7d3c9c7f63fa service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] No waiting events found dispatching network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:36 user nova-compute[75006]: WARNING nova.compute.manager [req-286e3939-213f-42c3-b2eb-6e7b56f2c08d req-ba8cf676-c129-4b3c-ac84-7d3c9c7f63fa service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received unexpected event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 for instance with vm_state active and task_state rebuild_spawning.
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:36 user nova-compute[75006]: WARNING nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:34:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:36 user nova-compute[75006]: WARNING nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:34:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:36 user nova-compute[75006]: WARNING nova.compute.manager [req-b86ab61c-01bc-4a08-8aa9-fc6d4a1aeb6f req-44702242-4a77-4191-af6a-86cb8f031f30 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 6990b476-cfd5-43c0-a295-5ee42393d35b {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 87c685b0-44b9-400b-b98a-2066988857f4 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 80529600-0aed-4f2b-b8ce-f3bacaabcd0e {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 54e46dc7-4d71-4720-9906-270ab0c872e7 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 5449b27f-2795-4ab6-a965-bdbbe9a9a59f {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "cb58f809-30cb-487b-b608-f2c7973d2225" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "87c685b0-44b9-400b-b98a-2066988857f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: INFO nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "54e46dc7-4d71-4720-9906-270ab0c872e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:37 user nova-compute[75006]: INFO nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "cb58f809-30cb-487b-b608-f2c7973d2225" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "87c685b0-44b9-400b-b98a-2066988857f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-35893e91-cbae-4065-baec-fd1f4afc7480 req-12f05a87-61ad-4683-9059-468d52a7150d service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35893e91-cbae-4065-baec-fd1f4afc7480 req-12f05a87-61ad-4683-9059-468d52a7150d service nova] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35893e91-cbae-4065-baec-fd1f4afc7480 req-12f05a87-61ad-4683-9059-468d52a7150d service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35893e91-cbae-4065-baec-fd1f4afc7480 req-12f05a87-61ad-4683-9059-468d52a7150d service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-35893e91-cbae-4065-baec-fd1f4afc7480 req-12f05a87-61ad-4683-9059-468d52a7150d service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] No waiting events found dispatching network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:38 user nova-compute[75006]: WARNING nova.compute.manager [req-35893e91-cbae-4065-baec-fd1f4afc7480 req-12f05a87-61ad-4683-9059-468d52a7150d service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received unexpected event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 for instance with vm_state active and task_state rebuild_spawning.
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:34:38 user nova-compute[75006]: INFO nova.compute.claims [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Claim successful on node user
Nov 27 03:34:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:34:38 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance spawned successfully.
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-5656537d-c66c-4e26-932e-73cf00b47f69 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.129s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.objects.instance [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75006) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.network.neutron [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:34:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:34:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dbd5b66d-5f1b-458c-a30d-01ede2bf59d2 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:34:39 user nova-compute[75006]: INFO nova.virt.block_device [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Booting with volume snapshot 1b6200af-28ff-4e08-bad9-f91122ecf522 at /dev/vda
Nov 27 03:34:39 user nova-compute[75006]: DEBUG nova.policy [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee3d2a74e8748c1aa045cc93d4894e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b1b7443dc44f21ac89452277f326b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG nova.network.neutron [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Successfully created port: 6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG nova.network.neutron [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Successfully updated port: 6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "refresh_cache-a983fac8-6c90-4b09-bfff-238fbdc70f0a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquired lock "refresh_cache-a983fac8-6c90-4b09-bfff-238fbdc70f0a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG nova.network.neutron [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-32031329-6a3c-4cf9-91ed-7428fe40b43e req-152aaf66-7d97-4e8d-861c-2ca7a64da44b service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received event network-changed-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG nova.compute.manager [req-32031329-6a3c-4cf9-91ed-7428fe40b43e req-152aaf66-7d97-4e8d-861c-2ca7a64da44b service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Refreshing instance network info cache due to event network-changed-6f8d5967-6826-4505-932a-1ad7658d06b4. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-32031329-6a3c-4cf9-91ed-7428fe40b43e req-152aaf66-7d97-4e8d-861c-2ca7a64da44b service nova] Acquiring lock "refresh_cache-a983fac8-6c90-4b09-bfff-238fbdc70f0a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:34:40 user nova-compute[75006]: DEBUG nova.network.neutron [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Updating instance_info_cache with network_info: [{"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Releasing lock "refresh_cache-a983fac8-6c90-4b09-bfff-238fbdc70f0a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Instance network_info: |[{"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-32031329-6a3c-4cf9-91ed-7428fe40b43e req-152aaf66-7d97-4e8d-861c-2ca7a64da44b service nova] Acquired lock "refresh_cache-a983fac8-6c90-4b09-bfff-238fbdc70f0a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG nova.network.neutron [req-32031329-6a3c-4cf9-91ed-7428fe40b43e req-152aaf66-7d97-4e8d-861c-2ca7a64da44b service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Refreshing network info cache for port 6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:34:41 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e is timed out.
Nov 27 03:34:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Successfully detached device vdb from instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e from the live domain config.
Nov 27 03:34:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CHQniPAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:41 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b27407-6687-42e5-bd54-f237eb853878]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:34:41 user nova-compute[75006]: No targets found.
Nov 27 03:34:41 user nova-compute[75006]: iSNS:
Nov 27 03:34:41 user nova-compute[75006]: No targets found.
Nov 27 03:34:41 user nova-compute[75006]: STATIC:
Nov 27 03:34:41 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f
Nov 27 03:34:41 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:41 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:41 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47
Nov 27 03:34:41 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:41 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:41 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:34:41 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:41 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:41 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5
Nov 27 03:34:41 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:34:41 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:34:41 user nova-compute[75006]: FIRMWARE:
Nov 27 03:34:41 user nova-compute[75006]: No targets found.
Nov 27 03:34:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:34:41 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:34:41 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c53e50-34f1-4c88-9aba-6a5c1462cb25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca77331-ffa0-463f-a1a0-b13ae95faa26]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:41 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:41 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:41 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:41 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:41 user nova-compute[75006]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f (non-flash)
Nov 27 03:34:41 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd42473ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f031cf33-c45e-44d5-b659-87c001bf1235]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG nova.network.neutron [req-32031329-6a3c-4cf9-91ed-7428fe40b43e req-152aaf66-7d97-4e8d-861c-2ca7a64da44b service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Updated VIF entry in instance network info cache for port 6f8d5967-6826-4505-932a-1ad7658d06b4. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG nova.network.neutron [req-32031329-6a3c-4cf9-91ed-7428fe40b43e req-152aaf66-7d97-4e8d-861c-2ca7a64da44b service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Updating instance_info_cache with network_info: [{"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[463fe20b-9e57-475c-819c-221624abb72b]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-32031329-6a3c-4cf9-91ed-7428fe40b43e req-152aaf66-7d97-4e8d-861c-2ca7a64da44b service nova] Releasing lock "refresh_cache-a983fac8-6c90-4b09-bfff-238fbdc70f0a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd24529c-7db0-4130-b645-35c35fc16f1e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dfcf25-0a29-4c92-bf9d-aaa557851e37]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9414a267-0895-4020-9ed7-1937a8cc093e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6ba8eb-6d1a-49d0-a1ce-2515744bc116]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f, portal: 172.16.0.220,3260]
Nov 27 03:34:41 user nova-compute[75006]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f, portal: 172.16.0.220,3260] successful.
Nov 27 03:34:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:229480ae-b634-4d37-9679-3ad1f9dae62f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f6194e-2358-4204-92e3-a4b9416edc20]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] <== disconnect_volume: return (357ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:34:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'flavor' on Instance uuid 80529600-0aed-4f2b-b8ce-f3bacaabcd0e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a2dd8253-05a8-4575-b6ec-866add130ad9 tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.807s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.493s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG os_brick.utils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0efb73-d3bf-40f7-a9fe-5e2d2a61d9fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5868f-b359-4cbf-a7ff-f7394eaab8f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ca8b70-023e-41bf-8009-c2c6a179c890]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2a079e-bbc1-4316-9bdf-ae4f26bf050e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:34:45 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:34:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa5821a-d82a-4b07-abc6-0b3ee0462ff0]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG os_brick.utils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:45 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Updating existing volume attachment record: ac1332a9-d41b-4a2a-93f6-ad595e956756 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:34:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:34:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Creating image(s)
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Ensure instance console log exists: /opt/stack/data/nova/instances/a983fac8-6c90-4b09-bfff-238fbdc70f0a/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Start _get_guest_xml network_info=[{"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'ac1332a9-d41b-4a2a-93f6-ad595e956756', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslcbMZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a983fac8-6c90-4b09-bfff-238fbdc70f0a', 'attached_at': '', 'detached_at': '', 'volume_id': '2805f5b7-28b9-400a-b6fd-75a0652493bb', 'serial': '2805f5b7-28b9-400a-b6fd-75a0652493bb'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:34:51 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:34:51 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslcbMZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:34:51 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:51 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:34:51 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c98776-1703-4675-95f7-3e170755371c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:34:51 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce0fd68-1f59-4c4a-81bd-4834108cb879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb] added
Nov 27 03:34:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[15893ec1-6e21-4f62-80df-201f5ef11b09]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ff997a-537a-4f3c-963c-0e7075dc6c47]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xslcbMZP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xslcbMZP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a29c0-1b73-4be3-83bf-6e6e0f17f918]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xslcbMZP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a00eeb8-9fbc-4504-b569-c9b3975e1327]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1428201-bb41-42c8-86d4-de39b096cf23]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3793604-e9b3-4f95-a525-b80348d871ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb, portal: 172.16.0.220,3260]
Nov 27 03:34:51 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb, portal: 172.16.0.220,3260] successful.
Nov 27 03:34:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f9f914-3bc7-4a71-becb-1f441b9e47c9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3590b1a3-a352-44a9-81f9-4bdac79e2f52]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb (non-flash)
Nov 27 03:34:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:34:51 user nova-compute[75006]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb (non-flash)
Nov 27 03:34:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7efe4f-81d5-4e5d-bffd-74f4dfa3f92f]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:34:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslcbMZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:34:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:34:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23165366564323764', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:34:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165366564323764', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1053076265',display_name='tempest-TestVolumeBootPattern-server-1053076265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1053076265',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-0kcz8wu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:34:39Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=a983fac8-6c90-4b09-bfff-238fbdc70f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:58,bridge_name='br-int',has_traffic_filtering=True,id=6f8d5967-6826-4505-932a-1ad7658d06b4,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8d5967-68') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.objects.instance [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'pci_devices' on Instance uuid a983fac8-6c90-4b09-bfff-238fbdc70f0a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:34:53 user nova-compute[75006]:   <uuid>a983fac8-6c90-4b09-bfff-238fbdc70f0a</uuid>
Nov 27 03:34:53 user nova-compute[75006]:   <name>instance-00000027</name>
Nov 27 03:34:53 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:34:53 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:34:53 user nova-compute[75006]:   <metadata>
Nov 27 03:34:53 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:34:53 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:34:53 user nova-compute[75006]:       <nova:name>tempest-TestVolumeBootPattern-server-1053076265</nova:name>
Nov 27 03:34:53 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:34:51</nova:creationTime>
Nov 27 03:34:53 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:34:53 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:34:53 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:34:53 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:34:53 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:34:53 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:34:53 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:34:53 user nova-compute[75006]:       <nova:owner>
Nov 27 03:34:53 user nova-compute[75006]:         <nova:user uuid="bee3d2a74e8748c1aa045cc93d4894e5">tempest-TestVolumeBootPattern-1716945418-project-member</nova:user>
Nov 27 03:34:53 user nova-compute[75006]:         <nova:project uuid="46b1b7443dc44f21ac89452277f326b1">tempest-TestVolumeBootPattern-1716945418</nova:project>
Nov 27 03:34:53 user nova-compute[75006]:       </nova:owner>
Nov 27 03:34:53 user nova-compute[75006]:       <nova:ports>
Nov 27 03:34:53 user nova-compute[75006]:         <nova:port uuid="6f8d5967-6826-4505-932a-1ad7658d06b4">
Nov 27 03:34:53 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 03:34:53 user nova-compute[75006]:         </nova:port>
Nov 27 03:34:53 user nova-compute[75006]:       </nova:ports>
Nov 27 03:34:53 user nova-compute[75006]:     </nova:instance>
Nov 27 03:34:53 user nova-compute[75006]:   </metadata>
Nov 27 03:34:53 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:34:53 user nova-compute[75006]:     <system>
Nov 27 03:34:53 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:34:53 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:34:53 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:34:53 user nova-compute[75006]:       <entry name="serial">a983fac8-6c90-4b09-bfff-238fbdc70f0a</entry>
Nov 27 03:34:53 user nova-compute[75006]:       <entry name="uuid">a983fac8-6c90-4b09-bfff-238fbdc70f0a</entry>
Nov 27 03:34:53 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:34:53 user nova-compute[75006]:     </system>
Nov 27 03:34:53 user nova-compute[75006]:   </sysinfo>
Nov 27 03:34:53 user nova-compute[75006]:   <os>
Nov 27 03:34:53 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:34:53 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:34:53 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:34:53 user nova-compute[75006]:   </os>
Nov 27 03:34:53 user nova-compute[75006]:   <features>
Nov 27 03:34:53 user nova-compute[75006]:     <acpi/>
Nov 27 03:34:53 user nova-compute[75006]:     <apic/>
Nov 27 03:34:53 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:34:53 user nova-compute[75006]:   </features>
Nov 27 03:34:53 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:34:53 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:34:53 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:34:53 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:34:53 user nova-compute[75006]:   </clock>
Nov 27 03:34:53 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:34:53 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:34:53 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:34:53 user nova-compute[75006]:   </cpu>
Nov 27 03:34:53 user nova-compute[75006]:   <devices>
Nov 27 03:34:53 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:34:53 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:34:53 user nova-compute[75006]:       <source dev="/dev/sdd"/>
Nov 27 03:34:53 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:34:53 user nova-compute[75006]:       <serial>2805f5b7-28b9-400a-b6fd-75a0652493bb</serial>
Nov 27 03:34:53 user nova-compute[75006]:     </disk>
Nov 27 03:34:53 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:34:53 user nova-compute[75006]:       <mac address="fa:16:3e:67:2a:58"/>
Nov 27 03:34:53 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:34:53 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:34:53 user nova-compute[75006]:       <target dev="tap6f8d5967-68"/>
Nov 27 03:34:53 user nova-compute[75006]:     </interface>
Nov 27 03:34:53 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:34:53 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/a983fac8-6c90-4b09-bfff-238fbdc70f0a/console.log" append="off"/>
Nov 27 03:34:53 user nova-compute[75006]:     </serial>
Nov 27 03:34:53 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:34:53 user nova-compute[75006]:     <video>
Nov 27 03:34:53 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:34:53 user nova-compute[75006]:     </video>
Nov 27 03:34:53 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:34:53 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:34:53 user nova-compute[75006]:     </rng>
Nov 27 03:34:53 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:34:53 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:34:53 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:34:53 user nova-compute[75006]:     </memballoon>
Nov 27 03:34:53 user nova-compute[75006]:   </devices>
Nov 27 03:34:53 user nova-compute[75006]: </domain>
Nov 27 03:34:53 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1053076265',display_name='tempest-TestVolumeBootPattern-server-1053076265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1053076265',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-0kcz8wu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:34:39Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=a983fac8-6c90-4b09-bfff-238fbdc70f0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:58,bridge_name='br-int',has_traffic_filtering=True,id=6f8d5967-6826-4505-932a-1ad7658d06b4,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8d5967-68') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG os_vif [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:58,bridge_name='br-int',has_traffic_filtering=True,id=6f8d5967-6826-4505-932a-1ad7658d06b4,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8d5967-68') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ede66aef-b548-52ea-91a5-43404f110846', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f8d5967-68, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f8d5967-68, col_values=(('qos', UUID('80292cbe-b6f0-485d-a58c-4061d87d7a2a')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f8d5967-68, col_values=(('external_ids', {'iface-id': '6f8d5967-6826-4505-932a-1ad7658d06b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:2a:58', 'vm-uuid': 'a983fac8-6c90-4b09-bfff-238fbdc70f0a'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:53 user nova-compute[75006]: INFO os_vif [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:58,bridge_name='br-int',has_traffic_filtering=True,id=6f8d5967-6826-4505-932a-1ad7658d06b4,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8d5967-68')
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:34:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No VIF found with MAC fa:16:3e:67:2a:58, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-ef8f128b-8518-4763-9c73-f6d749e7978e req-7b86d6f5-6b7c-4ac4-87a2-723fdf9a279b service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received event network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ef8f128b-8518-4763-9c73-f6d749e7978e req-7b86d6f5-6b7c-4ac4-87a2-723fdf9a279b service nova] Acquiring lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ef8f128b-8518-4763-9c73-f6d749e7978e req-7b86d6f5-6b7c-4ac4-87a2-723fdf9a279b service nova] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ef8f128b-8518-4763-9c73-f6d749e7978e req-7b86d6f5-6b7c-4ac4-87a2-723fdf9a279b service nova] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-ef8f128b-8518-4763-9c73-f6d749e7978e req-7b86d6f5-6b7c-4ac4-87a2-723fdf9a279b service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] No waiting events found dispatching network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:54 user nova-compute[75006]: WARNING nova.compute.manager [req-ef8f128b-8518-4763-9c73-f6d749e7978e req-7b86d6f5-6b7c-4ac4-87a2-723fdf9a279b service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received unexpected event network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 for instance with vm_state building and task_state spawning.
Nov 27 03:34:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:34:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Instance spawned successfully.
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:34:56 user nova-compute[75006]: INFO nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:34:56 user nova-compute[75006]: INFO nova.compute.manager [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Took 17.90 seconds to build instance.
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-7a9d7b47-3818-4b43-adcf-794386414d03 req-63780233-6537-4979-beeb-282e1bb6d517 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received event network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7a9d7b47-3818-4b43-adcf-794386414d03 req-63780233-6537-4979-beeb-282e1bb6d517 service nova] Acquiring lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7a9d7b47-3818-4b43-adcf-794386414d03 req-63780233-6537-4979-beeb-282e1bb6d517 service nova] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7a9d7b47-3818-4b43-adcf-794386414d03 req-63780233-6537-4979-beeb-282e1bb6d517 service nova] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-7a9d7b47-3818-4b43-adcf-794386414d03 req-63780233-6537-4979-beeb-282e1bb6d517 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] No waiting events found dispatching network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:34:56 user nova-compute[75006]: WARNING nova.compute.manager [req-7a9d7b47-3818-4b43-adcf-794386414d03 req-63780233-6537-4979-beeb-282e1bb6d517 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received unexpected event network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 for instance with vm_state active and task_state None.
Nov 27 03:34:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9ea734dd-a2f0-47cd-89ab-d4ee6fe14ba1 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.994s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:34:57 user nova-compute[75006]: INFO nova.compute.claims [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Claim successful on node user
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:34:57 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.policy [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46cd9289539949318955d507a4b12276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67aa5c34f5fb4c07a266ad0aa94d26f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:34:57 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Creating image(s)
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "/opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "/opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "/opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk 1073741824" returned: 0 in 0.057s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Successfully created port: 7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Cannot resize image /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Ensure instance console log exists: /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Successfully updated port: 7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "refresh_cache-f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquired lock "refresh_cache-f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-c5287471-6cfa-43cd-81c8-c11317c741d0 req-3b11a5b1-e2c0-4fcf-ad9f-13d24f663de5 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-changed-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-c5287471-6cfa-43cd-81c8-c11317c741d0 req-3b11a5b1-e2c0-4fcf-ad9f-13d24f663de5 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Refreshing instance network info cache due to event network-changed-7a31dbec-cc00-4001-8b62-6752e35d2ca0. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5287471-6cfa-43cd-81c8-c11317c741d0 req-3b11a5b1-e2c0-4fcf-ad9f-13d24f663de5 service nova] Acquiring lock "refresh_cache-f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Updating instance_info_cache with network_info: [{"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Releasing lock "refresh_cache-f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Instance network_info: |[{"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5287471-6cfa-43cd-81c8-c11317c741d0 req-3b11a5b1-e2c0-4fcf-ad9f-13d24f663de5 service nova] Acquired lock "refresh_cache-f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-c5287471-6cfa-43cd-81c8-c11317c741d0 req-3b11a5b1-e2c0-4fcf-ad9f-13d24f663de5 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Refreshing network info cache for port 7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Start _get_guest_xml network_info=[{"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:34:59 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:34:59 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-365957293',display_name='tempest-VolumesActionsTest-instance-365957293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-365957293',id=40,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67aa5c34f5fb4c07a266ad0aa94d26f7',ramdisk_id='',reservation_id='r-5wv79nmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-535517367',owner_user_name='tempest-VolumesActionsTest-535517367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:34:58Z,user_data=None,user_id='46cd9289539949318955d507a4b12276',uuid=f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converting VIF {"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:47,bridge_name='br-int',has_traffic_filtering=True,id=7a31dbec-cc00-4001-8b62-6752e35d2ca0,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a31dbec-cc') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lazy-loading 'pci_devices' on Instance uuid f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:34:59 user nova-compute[75006]:   <uuid>f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1</uuid>
Nov 27 03:34:59 user nova-compute[75006]:   <name>instance-00000028</name>
Nov 27 03:34:59 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:34:59 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:34:59 user nova-compute[75006]:   <metadata>
Nov 27 03:34:59 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:34:59 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:34:59 user nova-compute[75006]:       <nova:name>tempest-VolumesActionsTest-instance-365957293</nova:name>
Nov 27 03:34:59 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:34:59</nova:creationTime>
Nov 27 03:34:59 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:34:59 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:34:59 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:34:59 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:34:59 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:34:59 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:34:59 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:34:59 user nova-compute[75006]:       <nova:owner>
Nov 27 03:34:59 user nova-compute[75006]:         <nova:user uuid="46cd9289539949318955d507a4b12276">tempest-VolumesActionsTest-535517367-project-member</nova:user>
Nov 27 03:34:59 user nova-compute[75006]:         <nova:project uuid="67aa5c34f5fb4c07a266ad0aa94d26f7">tempest-VolumesActionsTest-535517367</nova:project>
Nov 27 03:34:59 user nova-compute[75006]:       </nova:owner>
Nov 27 03:34:59 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:34:59 user nova-compute[75006]:       <nova:ports>
Nov 27 03:34:59 user nova-compute[75006]:         <nova:port uuid="7a31dbec-cc00-4001-8b62-6752e35d2ca0">
Nov 27 03:34:59 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 03:34:59 user nova-compute[75006]:         </nova:port>
Nov 27 03:34:59 user nova-compute[75006]:       </nova:ports>
Nov 27 03:34:59 user nova-compute[75006]:     </nova:instance>
Nov 27 03:34:59 user nova-compute[75006]:   </metadata>
Nov 27 03:34:59 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:34:59 user nova-compute[75006]:     <system>
Nov 27 03:34:59 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:34:59 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:34:59 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:34:59 user nova-compute[75006]:       <entry name="serial">f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1</entry>
Nov 27 03:34:59 user nova-compute[75006]:       <entry name="uuid">f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1</entry>
Nov 27 03:34:59 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:34:59 user nova-compute[75006]:     </system>
Nov 27 03:34:59 user nova-compute[75006]:   </sysinfo>
Nov 27 03:34:59 user nova-compute[75006]:   <os>
Nov 27 03:34:59 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:34:59 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:34:59 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:34:59 user nova-compute[75006]:   </os>
Nov 27 03:34:59 user nova-compute[75006]:   <features>
Nov 27 03:34:59 user nova-compute[75006]:     <acpi/>
Nov 27 03:34:59 user nova-compute[75006]:     <apic/>
Nov 27 03:34:59 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:34:59 user nova-compute[75006]:   </features>
Nov 27 03:34:59 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:34:59 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:34:59 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:34:59 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:34:59 user nova-compute[75006]:   </clock>
Nov 27 03:34:59 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:34:59 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:34:59 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:34:59 user nova-compute[75006]:   </cpu>
Nov 27 03:34:59 user nova-compute[75006]:   <devices>
Nov 27 03:34:59 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:34:59 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:34:59 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk"/>
Nov 27 03:34:59 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:34:59 user nova-compute[75006]:     </disk>
Nov 27 03:34:59 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:34:59 user nova-compute[75006]:       <mac address="fa:16:3e:7e:14:47"/>
Nov 27 03:34:59 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:34:59 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:34:59 user nova-compute[75006]:       <target dev="tap7a31dbec-cc"/>
Nov 27 03:34:59 user nova-compute[75006]:     </interface>
Nov 27 03:34:59 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:34:59 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/console.log" append="off"/>
Nov 27 03:34:59 user nova-compute[75006]:     </serial>
Nov 27 03:34:59 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:34:59 user nova-compute[75006]:     <video>
Nov 27 03:34:59 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:34:59 user nova-compute[75006]:     </video>
Nov 27 03:34:59 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:34:59 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:34:59 user nova-compute[75006]:     </rng>
Nov 27 03:34:59 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:34:59 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:34:59 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:34:59 user nova-compute[75006]:     </memballoon>
Nov 27 03:34:59 user nova-compute[75006]:   </devices>
Nov 27 03:34:59 user nova-compute[75006]: </domain>
Nov 27 03:34:59 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-365957293',display_name='tempest-VolumesActionsTest-instance-365957293',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-365957293',id=40,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67aa5c34f5fb4c07a266ad0aa94d26f7',ramdisk_id='',reservation_id='r-5wv79nmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-535517367',owner_user_name='tempest-VolumesActionsTest-535517367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:34:58Z,user_data=None,user_id='46cd9289539949318955d507a4b12276',uuid=f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converting VIF {"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:47,bridge_name='br-int',has_traffic_filtering=True,id=7a31dbec-cc00-4001-8b62-6752e35d2ca0,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a31dbec-cc') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG os_vif [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:47,bridge_name='br-int',has_traffic_filtering=True,id=7a31dbec-cc00-4001-8b62-6752e35d2ca0,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a31dbec-cc') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c0c87ca-e0e2-55ce-9085-8189735e031d', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a31dbec-cc, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a31dbec-cc, col_values=(('qos', UUID('1692e4b6-bc02-4adc-92d9-b32ae12c3130')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a31dbec-cc, col_values=(('external_ids', {'iface-id': '7a31dbec-cc00-4001-8b62-6752e35d2ca0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:14:47', 'vm-uuid': 'f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:34:59 user nova-compute[75006]: INFO os_vif [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:47,bridge_name='br-int',has_traffic_filtering=True,id=7a31dbec-cc00-4001-8b62-6752e35d2ca0,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a31dbec-cc')
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] No VIF found with MAC fa:16:3e:7e:14:47, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-c5287471-6cfa-43cd-81c8-c11317c741d0 req-3b11a5b1-e2c0-4fcf-ad9f-13d24f663de5 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Updated VIF entry in instance network info cache for port 7a31dbec-cc00-4001-8b62-6752e35d2ca0. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:34:59 user nova-compute[75006]: DEBUG nova.network.neutron [req-c5287471-6cfa-43cd-81c8-c11317c741d0 req-3b11a5b1-e2c0-4fcf-ad9f-13d24f663de5 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Updating instance_info_cache with network_info: [{"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5287471-6cfa-43cd-81c8-c11317c741d0 req-3b11a5b1-e2c0-4fcf-ad9f-13d24f663de5 service nova] Releasing lock "refresh_cache-f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:35:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-fcd8b243-834d-4db6-bc9b-77623e3f9ab8 req-48cdf00b-c564-4f20-a66d-0efc0a7185ba service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fcd8b243-834d-4db6-bc9b-77623e3f9ab8 req-48cdf00b-c564-4f20-a66d-0efc0a7185ba service nova] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fcd8b243-834d-4db6-bc9b-77623e3f9ab8 req-48cdf00b-c564-4f20-a66d-0efc0a7185ba service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fcd8b243-834d-4db6-bc9b-77623e3f9ab8 req-48cdf00b-c564-4f20-a66d-0efc0a7185ba service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-fcd8b243-834d-4db6-bc9b-77623e3f9ab8 req-48cdf00b-c564-4f20-a66d-0efc0a7185ba service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] No waiting events found dispatching network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:35:02 user nova-compute[75006]: WARNING nova.compute.manager [req-fcd8b243-834d-4db6-bc9b-77623e3f9ab8 req-48cdf00b-c564-4f20-a66d-0efc0a7185ba service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received unexpected event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 for instance with vm_state building and task_state spawning.
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:35:03 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Instance spawned successfully.
Nov 27 03:35:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:35:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7664MB free_disk=24.994937896728516GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:03 user nova-compute[75006]: INFO nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6990b476-cfd5-43c0-a295-5ee42393d35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6b291b73-1b23-415a-ae61-f994d6e33d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance a983fac8-6c90-4b09-bfff-238fbdc70f0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:35:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:35:04 user nova-compute[75006]: INFO nova.compute.manager [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Took 6.94 seconds to build instance.
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e3b2c03a-9b6f-4876-b2a0-fd11954a4f78 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.040s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-2f711d42-7b69-4e83-9db4-e749e059a98e req-20eea62d-f9bb-407e-9254-edce91145c93 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2f711d42-7b69-4e83-9db4-e749e059a98e req-20eea62d-f9bb-407e-9254-edce91145c93 service nova] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2f711d42-7b69-4e83-9db4-e749e059a98e req-20eea62d-f9bb-407e-9254-edce91145c93 service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2f711d42-7b69-4e83-9db4-e749e059a98e req-20eea62d-f9bb-407e-9254-edce91145c93 service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-2f711d42-7b69-4e83-9db4-e749e059a98e req-20eea62d-f9bb-407e-9254-edce91145c93 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] No waiting events found dispatching network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:35:04 user nova-compute[75006]: WARNING nova.compute.manager [req-2f711d42-7b69-4e83-9db4-e749e059a98e req-20eea62d-f9bb-407e-9254-edce91145c93 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received unexpected event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 for instance with vm_state active and task_state None.
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.096s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:35:04 user nova-compute[75006]: INFO nova.compute.claims [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Claim successful on node user
Nov 27 03:35:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.network.neutron [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:35:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:35:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.policy [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6153e4e893d74cdcae25fae6db9fc589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891478cee7d4a89bd27cd45a9732ac9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:35:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Creating image(s)
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk 1073741824" returned: 0 in 0.082s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Successfully created port: eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Cannot resize image /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Ensure instance console log exists: /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updating instance_info_cache with network_info: [{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Successfully updated port: eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquired lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-c8aa2c49-69f9-4e59-b0de-eb067df765b5 req-e7397b5a-2ded-4c70-b848-3b7bcb410ad5 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-changed-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-c8aa2c49-69f9-4e59-b0de-eb067df765b5 req-e7397b5a-2ded-4c70-b848-3b7bcb410ad5 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Refreshing instance network info cache due to event network-changed-eaa6a3ce-8452-4582-ad29-df86bdf610aa. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c8aa2c49-69f9-4e59-b0de-eb067df765b5 req-e7397b5a-2ded-4c70-b848-3b7bcb410ad5 service nova] Acquiring lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating instance_info_cache with network_info: [{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Releasing lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance network_info: |[{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c8aa2c49-69f9-4e59-b0de-eb067df765b5 req-e7397b5a-2ded-4c70-b848-3b7bcb410ad5 service nova] Acquired lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.neutron [req-c8aa2c49-69f9-4e59-b0de-eb067df765b5 req-e7397b5a-2ded-4c70-b848-3b7bcb410ad5 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Refreshing network info cache for port eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Start _get_guest_xml network_info=[{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:35:06 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:35:06 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895041011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895041011',id=41,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJme53BRSXGv3FeW1R3zk9QGe+0Jem0+Jlf8BC9dvh0w+itxwcCsWMDyK6Am6GIFd5Qrn90XKlHZNkRy+MEGyAVQNFerPfmm0gojGtZ13OJJwnz4rXkcqx3ty1FaH+EjTg==',key_name='tempest-keypair-1897998770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-umhbpt7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=326427b4-70bc-49e0-ae50-b8daf2c3421a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.objects.instance [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'pci_devices' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:35:06 user nova-compute[75006]:   <uuid>326427b4-70bc-49e0-ae50-b8daf2c3421a</uuid>
Nov 27 03:35:06 user nova-compute[75006]:   <name>instance-00000029</name>
Nov 27 03:35:06 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:35:06 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:35:06 user nova-compute[75006]:   <metadata>
Nov 27 03:35:06 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:35:06 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:35:06 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1895041011</nova:name>
Nov 27 03:35:06 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:35:06</nova:creationTime>
Nov 27 03:35:06 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:35:06 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:35:06 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:35:06 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:35:06 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:35:06 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:35:06 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:35:06 user nova-compute[75006]:       <nova:owner>
Nov 27 03:35:06 user nova-compute[75006]:         <nova:user uuid="6153e4e893d74cdcae25fae6db9fc589">tempest-AttachVolumeShelveTestJSON-392586266-project-member</nova:user>
Nov 27 03:35:06 user nova-compute[75006]:         <nova:project uuid="8891478cee7d4a89bd27cd45a9732ac9">tempest-AttachVolumeShelveTestJSON-392586266</nova:project>
Nov 27 03:35:06 user nova-compute[75006]:       </nova:owner>
Nov 27 03:35:06 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:35:06 user nova-compute[75006]:       <nova:ports>
Nov 27 03:35:06 user nova-compute[75006]:         <nova:port uuid="eaa6a3ce-8452-4582-ad29-df86bdf610aa">
Nov 27 03:35:06 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 27 03:35:06 user nova-compute[75006]:         </nova:port>
Nov 27 03:35:06 user nova-compute[75006]:       </nova:ports>
Nov 27 03:35:06 user nova-compute[75006]:     </nova:instance>
Nov 27 03:35:06 user nova-compute[75006]:   </metadata>
Nov 27 03:35:06 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:35:06 user nova-compute[75006]:     <system>
Nov 27 03:35:06 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:35:06 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:35:06 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:35:06 user nova-compute[75006]:       <entry name="serial">326427b4-70bc-49e0-ae50-b8daf2c3421a</entry>
Nov 27 03:35:06 user nova-compute[75006]:       <entry name="uuid">326427b4-70bc-49e0-ae50-b8daf2c3421a</entry>
Nov 27 03:35:06 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:35:06 user nova-compute[75006]:     </system>
Nov 27 03:35:06 user nova-compute[75006]:   </sysinfo>
Nov 27 03:35:06 user nova-compute[75006]:   <os>
Nov 27 03:35:06 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:35:06 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:35:06 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:35:06 user nova-compute[75006]:   </os>
Nov 27 03:35:06 user nova-compute[75006]:   <features>
Nov 27 03:35:06 user nova-compute[75006]:     <acpi/>
Nov 27 03:35:06 user nova-compute[75006]:     <apic/>
Nov 27 03:35:06 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:35:06 user nova-compute[75006]:   </features>
Nov 27 03:35:06 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:35:06 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:35:06 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:35:06 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:35:06 user nova-compute[75006]:   </clock>
Nov 27 03:35:06 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:35:06 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:35:06 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:35:06 user nova-compute[75006]:   </cpu>
Nov 27 03:35:06 user nova-compute[75006]:   <devices>
Nov 27 03:35:06 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:35:06 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:35:06 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk"/>
Nov 27 03:35:06 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:35:06 user nova-compute[75006]:     </disk>
Nov 27 03:35:06 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:35:06 user nova-compute[75006]:       <mac address="fa:16:3e:0f:92:25"/>
Nov 27 03:35:06 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:35:06 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:35:06 user nova-compute[75006]:       <target dev="tapeaa6a3ce-84"/>
Nov 27 03:35:06 user nova-compute[75006]:     </interface>
Nov 27 03:35:06 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:35:06 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/console.log" append="off"/>
Nov 27 03:35:06 user nova-compute[75006]:     </serial>
Nov 27 03:35:06 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:35:06 user nova-compute[75006]:     <video>
Nov 27 03:35:06 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:35:06 user nova-compute[75006]:     </video>
Nov 27 03:35:06 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:35:06 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:35:06 user nova-compute[75006]:     </rng>
Nov 27 03:35:06 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:35:06 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:35:06 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:35:06 user nova-compute[75006]:     </memballoon>
Nov 27 03:35:06 user nova-compute[75006]:   </devices>
Nov 27 03:35:06 user nova-compute[75006]: </domain>
Nov 27 03:35:06 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895041011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895041011',id=41,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJme53BRSXGv3FeW1R3zk9QGe+0Jem0+Jlf8BC9dvh0w+itxwcCsWMDyK6Am6GIFd5Qrn90XKlHZNkRy+MEGyAVQNFerPfmm0gojGtZ13OJJwnz4rXkcqx3ty1FaH+EjTg==',key_name='tempest-keypair-1897998770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-umhbpt7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=326427b4-70bc-49e0-ae50-b8daf2c3421a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG os_vif [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88328aa1-4bd1-5311-a935-fe7b6a7d2671', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaa6a3ce-84, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaa6a3ce-84, col_values=(('qos', UUID('66f447b4-befc-4f46-bbeb-4db96872126d')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaa6a3ce-84, col_values=(('external_ids', {'iface-id': 'eaa6a3ce-8452-4582-ad29-df86bdf610aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:92:25', 'vm-uuid': '326427b4-70bc-49e0-ae50-b8daf2c3421a'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:35:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:07 user nova-compute[75006]: INFO os_vif [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84')
Nov 27 03:35:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:35:07 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No VIF found with MAC fa:16:3e:0f:92:25, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:35:07 user nova-compute[75006]: DEBUG nova.network.neutron [req-c8aa2c49-69f9-4e59-b0de-eb067df765b5 req-e7397b5a-2ded-4c70-b848-3b7bcb410ad5 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updated VIF entry in instance network info cache for port eaa6a3ce-8452-4582-ad29-df86bdf610aa. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:35:07 user nova-compute[75006]: DEBUG nova.network.neutron [req-c8aa2c49-69f9-4e59-b0de-eb067df765b5 req-e7397b5a-2ded-4c70-b848-3b7bcb410ad5 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating instance_info_cache with network_info: [{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:35:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c8aa2c49-69f9-4e59-b0de-eb067df765b5 req-e7397b5a-2ded-4c70-b848-3b7bcb410ad5 service nova] Releasing lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG nova.compute.manager [req-fb2a8ce8-e1a8-40a5-bca6-45a825ddd9fa req-e3f00f8e-cb3a-4abd-9e3e-27cfffd9ead7 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fb2a8ce8-e1a8-40a5-bca6-45a825ddd9fa req-e3f00f8e-cb3a-4abd-9e3e-27cfffd9ead7 service nova] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fb2a8ce8-e1a8-40a5-bca6-45a825ddd9fa req-e3f00f8e-cb3a-4abd-9e3e-27cfffd9ead7 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fb2a8ce8-e1a8-40a5-bca6-45a825ddd9fa req-e3f00f8e-cb3a-4abd-9e3e-27cfffd9ead7 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:08 user nova-compute[75006]: DEBUG nova.compute.manager [req-fb2a8ce8-e1a8-40a5-bca6-45a825ddd9fa req-e3f00f8e-cb3a-4abd-9e3e-27cfffd9ead7 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] No waiting events found dispatching network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:35:08 user nova-compute[75006]: WARNING nova.compute.manager [req-fb2a8ce8-e1a8-40a5-bca6-45a825ddd9fa req-e3f00f8e-cb3a-4abd-9e3e-27cfffd9ead7 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received unexpected event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa for instance with vm_state building and task_state spawning.
Nov 27 03:35:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:35:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance spawned successfully.
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-a58ff833-6092-4598-b048-1e0bd4c0d560 req-b91dfb52-3284-4e61-9a0b-ad9055fadef7 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a58ff833-6092-4598-b048-1e0bd4c0d560 req-b91dfb52-3284-4e61-9a0b-ad9055fadef7 service nova] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a58ff833-6092-4598-b048-1e0bd4c0d560 req-b91dfb52-3284-4e61-9a0b-ad9055fadef7 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a58ff833-6092-4598-b048-1e0bd4c0d560 req-b91dfb52-3284-4e61-9a0b-ad9055fadef7 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-a58ff833-6092-4598-b048-1e0bd4c0d560 req-b91dfb52-3284-4e61-9a0b-ad9055fadef7 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] No waiting events found dispatching network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:35:10 user nova-compute[75006]: WARNING nova.compute.manager [req-a58ff833-6092-4598-b048-1e0bd4c0d560 req-b91dfb52-3284-4e61-9a0b-ad9055fadef7 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received unexpected event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa for instance with vm_state building and task_state spawning.
Nov 27 03:35:10 user nova-compute[75006]: INFO nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 27 03:35:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:35:10 user nova-compute[75006]: INFO nova.compute.manager [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Took 6.46 seconds to build instance.
Nov 27 03:35:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-90658e46-d135-44f0-9239-28c6a9f4c1f4 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.562s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-a1bcc881-86da-48e3-8992-c5f045722c7e req-2158e98b-0b22-4e90-ba92-2f11b8503f2a service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-changed-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-a1bcc881-86da-48e3-8992-c5f045722c7e req-2158e98b-0b22-4e90-ba92-2f11b8503f2a service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Refreshing instance network info cache due to event network-changed-92f23dbf-0296-4f81-ba74-65e74dd75d0a. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a1bcc881-86da-48e3-8992-c5f045722c7e req-2158e98b-0b22-4e90-ba92-2f11b8503f2a service nova] Acquiring lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a1bcc881-86da-48e3-8992-c5f045722c7e req-2158e98b-0b22-4e90-ba92-2f11b8503f2a service nova] Acquired lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG nova.network.neutron [req-a1bcc881-86da-48e3-8992-c5f045722c7e req-2158e98b-0b22-4e90-ba92-2f11b8503f2a service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Refreshing network info cache for port 92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:11 user nova-compute[75006]: INFO nova.compute.manager [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Terminating instance
Nov 27 03:35:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:35:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-18f48bfc-137f-4048-a5d1-5f26dc93ff88 req-aafebcb8-4bc8-41be-ae82-2ff66033d4b7 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-vif-unplugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-18f48bfc-137f-4048-a5d1-5f26dc93ff88 req-aafebcb8-4bc8-41be-ae82-2ff66033d4b7 service nova] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-18f48bfc-137f-4048-a5d1-5f26dc93ff88 req-aafebcb8-4bc8-41be-ae82-2ff66033d4b7 service nova] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-18f48bfc-137f-4048-a5d1-5f26dc93ff88 req-aafebcb8-4bc8-41be-ae82-2ff66033d4b7 service nova] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-18f48bfc-137f-4048-a5d1-5f26dc93ff88 req-aafebcb8-4bc8-41be-ae82-2ff66033d4b7 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] No waiting events found dispatching network-vif-unplugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-18f48bfc-137f-4048-a5d1-5f26dc93ff88 req-aafebcb8-4bc8-41be-ae82-2ff66033d4b7 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-vif-unplugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-a1bcc881-86da-48e3-8992-c5f045722c7e req-2158e98b-0b22-4e90-ba92-2f11b8503f2a service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updated VIF entry in instance network info cache for port 92f23dbf-0296-4f81-ba74-65e74dd75d0a. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-a1bcc881-86da-48e3-8992-c5f045722c7e req-2158e98b-0b22-4e90-ba92-2f11b8503f2a service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updating instance_info_cache with network_info: [{"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a1bcc881-86da-48e3-8992-c5f045722c7e req-2158e98b-0b22-4e90-ba92-2f11b8503f2a service nova] Releasing lock "refresh_cache-80529600-0aed-4f2b-b8ce-f3bacaabcd0e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:35:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Instance destroyed successfully.
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.objects.instance [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'resources' on Instance uuid 80529600-0aed-4f2b-b8ce-f3bacaabcd0e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:32:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1003990568',display_name='tempest-TestStampPattern-server-1003990568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1003990568',id=36,image_ref='f23c80e3-4a81-4687-9a79-41ea2a3e79b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCvEMUIZDar/9uKmjM+iVQHTuryauOaSvt4utJ6Dze5XI9Qu+OWQuvie19iCR6iK3Kap2FXhDlTmZNuKNo1KhaH5r71CU3Tiaop1CqRcF45PpszmuxGaWkGiSqEIk0MhA==',key_name='tempest-TestStampPattern-920267456',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb74bd34122d4fde87e2ec3dee947b9d',ramdisk_id='',reservation_id='r-ld6r99i0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6990b476-cfd5-43c0-a295-5ee42393d35b',image_min_disk='1',image_min_ram='0',image_owner_id='bb74bd34122d4fde87e2ec3dee947b9d',image_owner_project_name='tempest-TestStampPattern-250178234',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-250178234-project-member',image_user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',owner_project_name='tempest-TestStampPattern-250178234',owner_user_name='tempest-TestStampPattern-250178234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:32:27Z,user_data=None,user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',uuid=80529600-0aed-4f2b-b8ce-f3bacaabcd0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converting VIF {"id": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "address": "fa:16:3e:44:bc:68", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92f23dbf-02", "ovs_interfaceid": "92f23dbf-0296-4f81-ba74-65e74dd75d0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=92f23dbf-0296-4f81-ba74-65e74dd75d0a,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f23dbf-02') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG os_vif [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=92f23dbf-0296-4f81-ba74-65e74dd75d0a,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f23dbf-02') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92f23dbf-02, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fffab4b7-67d4-4293-a431-54cd9e207c7e) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:35:12 user nova-compute[75006]: INFO os_vif [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:bc:68,bridge_name='br-int',has_traffic_filtering=True,id=92f23dbf-0296-4f81-ba74-65e74dd75d0a,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92f23dbf-02')
Nov 27 03:35:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Deleting instance files /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e_del
Nov 27 03:35:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Deletion of /opt/stack/data/nova/instances/80529600-0aed-4f2b-b8ce-f3bacaabcd0e_del complete
Nov 27 03:35:12 user nova-compute[75006]: INFO nova.compute.manager [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 27 03:35:12 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:35:12 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:35:13 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:35:13 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Took 0.48 seconds to deallocate network for instance.
Nov 27 03:35:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:13 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:35:13 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:35:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-0c70618a-bd68-4e29-9f70-74fd83008cea req-da28c428-0384-4d8b-a069-a27ac05197a1 service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-vif-deleted-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:13 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Deleted allocations for instance 80529600-0aed-4f2b-b8ce-f3bacaabcd0e
Nov 27 03:35:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-97ae3b5b-4423-4057-9958-2226d93bba4c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-da8685f9-83e6-4fbb-a563-ada559b21091 req-db72f2cc-9675-46e2-9840-f48d384d386f service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received event network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:35:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da8685f9-83e6-4fbb-a563-ada559b21091 req-db72f2cc-9675-46e2-9840-f48d384d386f service nova] Acquiring lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da8685f9-83e6-4fbb-a563-ada559b21091 req-db72f2cc-9675-46e2-9840-f48d384d386f service nova] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da8685f9-83e6-4fbb-a563-ada559b21091 req-db72f2cc-9675-46e2-9840-f48d384d386f service nova] Lock "80529600-0aed-4f2b-b8ce-f3bacaabcd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-da8685f9-83e6-4fbb-a563-ada559b21091 req-db72f2cc-9675-46e2-9840-f48d384d386f service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] No waiting events found dispatching network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:35:14 user nova-compute[75006]: WARNING nova.compute.manager [req-da8685f9-83e6-4fbb-a563-ada559b21091 req-db72f2cc-9675-46e2-9840-f48d384d386f service nova] [instance: 80529600-0aed-4f2b-b8ce-f3bacaabcd0e] Received unexpected event network-vif-plugged-92f23dbf-0296-4f81-ba74-65e74dd75d0a for instance with vm_state deleted and task_state None.
Nov 27 03:35:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:35:32 user nova-compute[75006]: INFO nova.compute.manager [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] instance snapshotting
Nov 27 03:35:32 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Beginning live snapshot process
Nov 27 03:35:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json -f qcow2 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json -f qcow2 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpldcbek6_/d0d094d16cb14243a99390bdeff9b6eb.delta 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpldcbek6_/d0d094d16cb14243a99390bdeff9b6eb.delta 1073741824" returned: 0 in 0.062s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 03:35:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] COPY block job progress, current cursor: 131072 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:35:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75006) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 03:35:34 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 03:35:34 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:35:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpldcbek6_/d0d094d16cb14243a99390bdeff9b6eb.delta /opt/stack/data/nova/instances/snapshots/tmpldcbek6_/d0d094d16cb14243a99390bdeff9b6eb {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpldcbek6_/d0d094d16cb14243a99390bdeff9b6eb.delta /opt/stack/data/nova/instances/snapshots/tmpldcbek6_/d0d094d16cb14243a99390bdeff9b6eb" returned: 0 in 0.440s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:35 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Snapshot extracted, beginning image upload
Nov 27 03:35:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Snapshot image upload complete
Nov 27 03:35:37 user nova-compute[75006]: INFO nova.compute.manager [None req-0a3a84fb-62ea-41dd-975b-3dfd17ce0741 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Took 5.06 seconds to snapshot the instance on the hypervisor.
Nov 27 03:35:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:55 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:56 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:35:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:35:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:35:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:35:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:35:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:35:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:35:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:35:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:35:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:35:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:35:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:36:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:36:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7359MB free_disk=24.887222290039062GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6990b476-cfd5-43c0-a295-5ee42393d35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6b291b73-1b23-415a-ae61-f994d6e33d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance a983fac8-6c90-4b09-bfff-238fbdc70f0a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 326427b4-70bc-49e0-ae50-b8daf2c3421a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:36:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:36:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:36:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:36:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:36:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updating instance_info_cache with network_info: [{"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:36:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:36:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:36:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-44d176b3-9a9e-4d41-80e1-b57f6b74a53d req-032510fd-7ee8-4984-9461-e2c37747b6ce service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-changed-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-44d176b3-9a9e-4d41-80e1-b57f6b74a53d req-032510fd-7ee8-4984-9461-e2c37747b6ce service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Refreshing instance network info cache due to event network-changed-c1ecf59a-5a42-4cfb-be41-dc5182153ce5. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-44d176b3-9a9e-4d41-80e1-b57f6b74a53d req-032510fd-7ee8-4984-9461-e2c37747b6ce service nova] Acquiring lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-44d176b3-9a9e-4d41-80e1-b57f6b74a53d req-032510fd-7ee8-4984-9461-e2c37747b6ce service nova] Acquired lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-44d176b3-9a9e-4d41-80e1-b57f6b74a53d req-032510fd-7ee8-4984-9461-e2c37747b6ce service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Refreshing network info cache for port c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:09 user nova-compute[75006]: INFO nova.compute.manager [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Terminating instance
Nov 27 03:36:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-f8772665-a973-4867-b687-9f94be9648c9 req-95c13e54-fd68-4a75-bb82-b849d0f36ae8 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-vif-unplugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f8772665-a973-4867-b687-9f94be9648c9 req-95c13e54-fd68-4a75-bb82-b849d0f36ae8 service nova] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f8772665-a973-4867-b687-9f94be9648c9 req-95c13e54-fd68-4a75-bb82-b849d0f36ae8 service nova] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f8772665-a973-4867-b687-9f94be9648c9 req-95c13e54-fd68-4a75-bb82-b849d0f36ae8 service nova] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-f8772665-a973-4867-b687-9f94be9648c9 req-95c13e54-fd68-4a75-bb82-b849d0f36ae8 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] No waiting events found dispatching network-vif-unplugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-f8772665-a973-4867-b687-9f94be9648c9 req-95c13e54-fd68-4a75-bb82-b849d0f36ae8 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-vif-unplugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-44d176b3-9a9e-4d41-80e1-b57f6b74a53d req-032510fd-7ee8-4984-9461-e2c37747b6ce service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updated VIF entry in instance network info cache for port c1ecf59a-5a42-4cfb-be41-dc5182153ce5. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.network.neutron [req-44d176b3-9a9e-4d41-80e1-b57f6b74a53d req-032510fd-7ee8-4984-9461-e2c37747b6ce service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updating instance_info_cache with network_info: [{"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-44d176b3-9a9e-4d41-80e1-b57f6b74a53d req-032510fd-7ee8-4984-9461-e2c37747b6ce service nova] Releasing lock "refresh_cache-6990b476-cfd5-43c0-a295-5ee42393d35b" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:36:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Instance destroyed successfully.
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lazy-loading 'resources' on Instance uuid 6990b476-cfd5-43c0-a295-5ee42393d35b {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1609677707',display_name='tempest-TestStampPattern-server-1609677707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1609677707',id=32,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCvEMUIZDar/9uKmjM+iVQHTuryauOaSvt4utJ6Dze5XI9Qu+OWQuvie19iCR6iK3Kap2FXhDlTmZNuKNo1KhaH5r71CU3Tiaop1CqRcF45PpszmuxGaWkGiSqEIk0MhA==',key_name='tempest-TestStampPattern-920267456',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb74bd34122d4fde87e2ec3dee947b9d',ramdisk_id='',reservation_id='r-dyjbzzxp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-250178234',owner_user_name='tempest-TestStampPattern-250178234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:32:14Z,user_data=None,user_id='e8a9fbc3a61f4c60ab5d911ebe3e5053',uuid=6990b476-cfd5-43c0-a295-5ee42393d35b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converting VIF {"id": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "address": "fa:16:3e:3c:99:fd", "network": {"id": "68f3ed6c-560d-4eba-8800-4e8762b6e087", "bridge": "br-int", "label": "tempest-TestStampPattern-1926137647-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb74bd34122d4fde87e2ec3dee947b9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1ecf59a-5a", "ovs_interfaceid": "c1ecf59a-5a42-4cfb-be41-dc5182153ce5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:99:fd,bridge_name='br-int',has_traffic_filtering=True,id=c1ecf59a-5a42-4cfb-be41-dc5182153ce5,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ecf59a-5a') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG os_vif [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:99:fd,bridge_name='br-int',has_traffic_filtering=True,id=c1ecf59a-5a42-4cfb-be41-dc5182153ce5,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ecf59a-5a') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1ecf59a-5a, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c297db72-78cd-4c6a-8938-1c6e4d1e474a) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:10 user nova-compute[75006]: INFO os_vif [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:99:fd,bridge_name='br-int',has_traffic_filtering=True,id=c1ecf59a-5a42-4cfb-be41-dc5182153ce5,network=Network(68f3ed6c-560d-4eba-8800-4e8762b6e087),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1ecf59a-5a')
Nov 27 03:36:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Deleting instance files /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b_del
Nov 27 03:36:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Deletion of /opt/stack/data/nova/instances/6990b476-cfd5-43c0-a295-5ee42393d35b_del complete
Nov 27 03:36:10 user nova-compute[75006]: INFO nova.compute.manager [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 27 03:36:10 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:36:10 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:36:11 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:11 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Took 0.47 seconds to deallocate network for instance.
Nov 27 03:36:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:11 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:36:11 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:36:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:11 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Deleted allocations for instance 6990b476-cfd5-43c0-a295-5ee42393d35b
Nov 27 03:36:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f8446799-841c-4179-bbb3-2d4375bd894c tempest-TestStampPattern-250178234 tempest-TestStampPattern-250178234-project-member] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.885s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-871ce70f-c593-4b87-b406-fe66cac962ae req-5a82eccc-186a-4a40-8fc9-bb094556de03 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-871ce70f-c593-4b87-b406-fe66cac962ae req-5a82eccc-186a-4a40-8fc9-bb094556de03 service nova] Acquiring lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-871ce70f-c593-4b87-b406-fe66cac962ae req-5a82eccc-186a-4a40-8fc9-bb094556de03 service nova] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-871ce70f-c593-4b87-b406-fe66cac962ae req-5a82eccc-186a-4a40-8fc9-bb094556de03 service nova] Lock "6990b476-cfd5-43c0-a295-5ee42393d35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-871ce70f-c593-4b87-b406-fe66cac962ae req-5a82eccc-186a-4a40-8fc9-bb094556de03 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] No waiting events found dispatching network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:12 user nova-compute[75006]: WARNING nova.compute.manager [req-871ce70f-c593-4b87-b406-fe66cac962ae req-5a82eccc-186a-4a40-8fc9-bb094556de03 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received unexpected event network-vif-plugged-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 for instance with vm_state deleted and task_state None.
Nov 27 03:36:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-871ce70f-c593-4b87-b406-fe66cac962ae req-5a82eccc-186a-4a40-8fc9-bb094556de03 service nova] [instance: 6990b476-cfd5-43c0-a295-5ee42393d35b] Received event network-vif-deleted-c1ecf59a-5a42-4cfb-be41-dc5182153ce5 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-c97cd500-faed-4f41-8411-fec2d1bccdfd req-4d75cd5d-c11b-40e1-b8d1-24a5a2c0eecc service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-changed-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-c97cd500-faed-4f41-8411-fec2d1bccdfd req-4d75cd5d-c11b-40e1-b8d1-24a5a2c0eecc service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Refreshing instance network info cache due to event network-changed-1fc740fe-93b7-49bc-8136-86b411ec34c0. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c97cd500-faed-4f41-8411-fec2d1bccdfd req-4d75cd5d-c11b-40e1-b8d1-24a5a2c0eecc service nova] Acquiring lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c97cd500-faed-4f41-8411-fec2d1bccdfd req-4d75cd5d-c11b-40e1-b8d1-24a5a2c0eecc service nova] Acquired lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.network.neutron [req-c97cd500-faed-4f41-8411-fec2d1bccdfd req-4d75cd5d-c11b-40e1-b8d1-24a5a2c0eecc service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Refreshing network info cache for port 1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:24 user nova-compute[75006]: INFO nova.compute.manager [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Detaching volume 783cb71c-489b-4a70-8c97-3fdd6afba4f5
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.network.neutron [req-c97cd500-faed-4f41-8411-fec2d1bccdfd req-4d75cd5d-c11b-40e1-b8d1-24a5a2c0eecc service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updated VIF entry in instance network info cache for port 1fc740fe-93b7-49bc-8136-86b411ec34c0. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.network.neutron [req-c97cd500-faed-4f41-8411-fec2d1bccdfd req-4d75cd5d-c11b-40e1-b8d1-24a5a2c0eecc service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating instance_info_cache with network_info: [{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:24 user nova-compute[75006]: INFO nova.virt.block_device [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Attempting to driver detach volume 783cb71c-489b-4a70-8c97-3fdd6afba4f5 from mountpoint /dev/vdb
Nov 27 03:36:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c97cd500-faed-4f41-8411-fec2d1bccdfd req-4d75cd5d-c11b-40e1-b8d1-24a5a2c0eecc service nova] Releasing lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Attempting to detach device vdb from instance 6b291b73-1b23-415a-ae61-f994d6e33d7e from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:36:24 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:36:24 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:36:24 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:36:24 user nova-compute[75006]:   <serial>783cb71c-489b-4a70-8c97-3fdd6afba4f5</serial>
Nov 27 03:36:24 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:36:24 user nova-compute[75006]: </disk>
Nov 27 03:36:24 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:36:24 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Successfully detached device vdb from instance 6b291b73-1b23-415a-ae61-f994d6e33d7e from the persistent domain config.
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6b291b73-1b23-415a-ae61-f994d6e33d7e from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:36:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:36:24 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:36:24 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:36:24 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:36:24 user nova-compute[75006]:   <serial>783cb71c-489b-4a70-8c97-3fdd6afba4f5</serial>
Nov 27 03:36:24 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:36:24 user nova-compute[75006]: </disk>
Nov 27 03:36:24 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:36:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:25 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:36:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-fa426463-b254-4da4-8e81-f58c1224c512 req-ae844fcf-0498-42a3-a90c-891f7c175b49 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-changed-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:26 user nova-compute[75006]: DEBUG nova.compute.manager [req-fa426463-b254-4da4-8e81-f58c1224c512 req-ae844fcf-0498-42a3-a90c-891f7c175b49 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Refreshing instance network info cache due to event network-changed-1fc740fe-93b7-49bc-8136-86b411ec34c0. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:36:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa426463-b254-4da4-8e81-f58c1224c512 req-ae844fcf-0498-42a3-a90c-891f7c175b49 service nova] Acquiring lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:36:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa426463-b254-4da4-8e81-f58c1224c512 req-ae844fcf-0498-42a3-a90c-891f7c175b49 service nova] Acquired lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:36:26 user nova-compute[75006]: DEBUG nova.network.neutron [req-fa426463-b254-4da4-8e81-f58c1224c512 req-ae844fcf-0498-42a3-a90c-891f7c175b49 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Refreshing network info cache for port 1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:36:26 user nova-compute[75006]: DEBUG nova.network.neutron [req-fa426463-b254-4da4-8e81-f58c1224c512 req-ae844fcf-0498-42a3-a90c-891f7c175b49 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updated VIF entry in instance network info cache for port 1fc740fe-93b7-49bc-8136-86b411ec34c0. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:36:26 user nova-compute[75006]: DEBUG nova.network.neutron [req-fa426463-b254-4da4-8e81-f58c1224c512 req-ae844fcf-0498-42a3-a90c-891f7c175b49 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating instance_info_cache with network_info: [{"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fa426463-b254-4da4-8e81-f58c1224c512 req-ae844fcf-0498-42a3-a90c-891f7c175b49 service nova] Releasing lock "refresh_cache-6b291b73-1b23-415a-ae61-f994d6e33d7e" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:29 user nova-compute[75006]: INFO nova.compute.manager [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Terminating instance
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-35d78edc-4a2a-4427-a4b3-e4b2e35f2e4e req-ec308531-c749-498f-9022-3f959bdef834 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received event network-vif-unplugged-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35d78edc-4a2a-4427-a4b3-e4b2e35f2e4e req-ec308531-c749-498f-9022-3f959bdef834 service nova] Acquiring lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35d78edc-4a2a-4427-a4b3-e4b2e35f2e4e req-ec308531-c749-498f-9022-3f959bdef834 service nova] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-35d78edc-4a2a-4427-a4b3-e4b2e35f2e4e req-ec308531-c749-498f-9022-3f959bdef834 service nova] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-35d78edc-4a2a-4427-a4b3-e4b2e35f2e4e req-ec308531-c749-498f-9022-3f959bdef834 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] No waiting events found dispatching network-vif-unplugged-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-35d78edc-4a2a-4427-a4b3-e4b2e35f2e4e req-ec308531-c749-498f-9022-3f959bdef834 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received event network-vif-unplugged-6f8d5967-6826-4505-932a-1ad7658d06b4 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:36:29 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Instance destroyed successfully.
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.objects.instance [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'resources' on Instance uuid a983fac8-6c90-4b09-bfff-238fbdc70f0a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1053076265',display_name='tempest-TestVolumeBootPattern-server-1053076265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1053076265',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:34:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-0kcz8wu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:34:57Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=a983fac8-6c90-4b09-bfff-238fbdc70f0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "6f8d5967-6826-4505-932a-1ad7658d06b4", "address": "fa:16:3e:67:2a:58", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f8d5967-68", "ovs_interfaceid": "6f8d5967-6826-4505-932a-1ad7658d06b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:58,bridge_name='br-int',has_traffic_filtering=True,id=6f8d5967-6826-4505-932a-1ad7658d06b4,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8d5967-68') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG os_vif [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:58,bridge_name='br-int',has_traffic_filtering=True,id=6f8d5967-6826-4505-932a-1ad7658d06b4,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8d5967-68') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f8d5967-68, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80292cbe-b6f0-485d-a58c-4061d87d7a2a) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:36:29 user nova-compute[75006]: INFO os_vif [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:2a:58,bridge_name='br-int',has_traffic_filtering=True,id=6f8d5967-6826-4505-932a-1ad7658d06b4,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f8d5967-68')
Nov 27 03:36:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xslcbMZP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:36:29 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:36:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b815cdcd-63c4-49bb-b565-5993b5ba74e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:36:29 user nova-compute[75006]: No targets found.
Nov 27 03:36:29 user nova-compute[75006]: iSNS:
Nov 27 03:36:29 user nova-compute[75006]: No targets found.
Nov 27 03:36:29 user nova-compute[75006]: STATIC:
Nov 27 03:36:29 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb
Nov 27 03:36:29 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:36:29 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:36:29 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47
Nov 27 03:36:29 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:36:29 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:36:29 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:36:29 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:36:29 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:36:29 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5
Nov 27 03:36:29 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:36:29 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:36:29 user nova-compute[75006]: FIRMWARE:
Nov 27 03:36:29 user nova-compute[75006]: No targets found.
Nov 27 03:36:29 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:36:29 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:36:29 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2eea5d-7212-4d0c-898e-d64eb1a303b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b34d2dd-a4c4-492f-9306-0ec7c5781da7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:36:30 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:36:30 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:36:30 user nova-compute[75006]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb (non-flash)
Nov 27 03:36:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:36:30 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:36:30 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:36:30 user nova-compute[75006]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb (non-flash)
Nov 27 03:36:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4482e3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[293197ab-803c-47d8-9aaa-fd4375356a44]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a69bc75-bf11-47ac-8b62-bf65e96abed0]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[96edc544-119a-46bf-b12d-ed2e915438fd]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a337f9-df17-40ac-b980-a7b6b32c5852]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[621294b8-f389-4509-a5d9-0dc5bc1babe9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5205c80b-090e-4407-9905-89e2ca0b740a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb, portal: 172.16.0.220,3260]
Nov 27 03:36:30 user nova-compute[75006]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb, portal: 172.16.0.220,3260] successful.
Nov 27 03:36:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2805f5b7-28b9-400a-b6fd-75a0652493bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873a2f9-8c8f-49dc-b383-68b0ffcfbe0a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== disconnect_volume: return (319ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:36:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Deleting instance files /opt/stack/data/nova/instances/a983fac8-6c90-4b09-bfff-238fbdc70f0a_del
Nov 27 03:36:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Deletion of /opt/stack/data/nova/instances/a983fac8-6c90-4b09-bfff-238fbdc70f0a_del complete
Nov 27 03:36:30 user nova-compute[75006]: INFO nova.compute.manager [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 27 03:36:30 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:30 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Took 0.45 seconds to deallocate network for instance.
Nov 27 03:36:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f5f40e4-15c8-456d-94d5-ad3ba2865fb2 req-3a230a11-ab9e-41b1-9f43-dc4886b17c4d service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received event network-vif-deleted-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:30 user nova-compute[75006]: INFO nova.compute.manager [req-3f5f40e4-15c8-456d-94d5-ad3ba2865fb2 req-3a230a11-ab9e-41b1-9f43-dc4886b17c4d service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Neutron deleted interface 6f8d5967-6826-4505-932a-1ad7658d06b4; detaching it from the instance and deleting it from the info cache
Nov 27 03:36:30 user nova-compute[75006]: DEBUG nova.network.neutron [req-3f5f40e4-15c8-456d-94d5-ad3ba2865fb2 req-3a230a11-ab9e-41b1-9f43-dc4886b17c4d service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-3f5f40e4-15c8-456d-94d5-ad3ba2865fb2 req-3a230a11-ab9e-41b1-9f43-dc4886b17c4d service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Detach interface failed, port_id=6f8d5967-6826-4505-932a-1ad7658d06b4, reason: Instance a983fac8-6c90-4b09-bfff-238fbdc70f0a could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-bef2f564-523f-4e11-a893-03de8956c36c req-bbb63137-5a8a-4ef6-ad59-df85aeff2c51 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received event network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bef2f564-523f-4e11-a893-03de8956c36c req-bbb63137-5a8a-4ef6-ad59-df85aeff2c51 service nova] Acquiring lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bef2f564-523f-4e11-a893-03de8956c36c req-bbb63137-5a8a-4ef6-ad59-df85aeff2c51 service nova] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bef2f564-523f-4e11-a893-03de8956c36c req-bbb63137-5a8a-4ef6-ad59-df85aeff2c51 service nova] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-bef2f564-523f-4e11-a893-03de8956c36c req-bbb63137-5a8a-4ef6-ad59-df85aeff2c51 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] No waiting events found dispatching network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:31 user nova-compute[75006]: WARNING nova.compute.manager [req-bef2f564-523f-4e11-a893-03de8956c36c req-bbb63137-5a8a-4ef6-ad59-df85aeff2c51 service nova] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Received unexpected event network-vif-plugged-6f8d5967-6826-4505-932a-1ad7658d06b4 for instance with vm_state active and task_state deleting.
Nov 27 03:36:31 user nova-compute[75006]: INFO nova.compute.manager [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Took 0.79 seconds to detach 1 volumes for instance.
Nov 27 03:36:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: a983fac8-6c90-4b09-bfff-238fbdc70f0a] Deleting volume: 2805f5b7-28b9-400a-b6fd-75a0652493bb {{(pid=75006) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:36:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:36:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:32 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Deleted allocations for instance a983fac8-6c90-4b09-bfff-238fbdc70f0a
Nov 27 03:36:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-86fd8714-8af3-48ba-8160-827dd5e4549e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "a983fac8-6c90-4b09-bfff-238fbdc70f0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.007s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:36:39 user nova-compute[75006]: INFO nova.compute.claims [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Claim successful on node user
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.network.neutron [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:36:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG nova.policy [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bdc7ee98a95432d96679fc697b7d61d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03bbdcea84574886bbea67eefc84dca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:36:39 user nova-compute[75006]: INFO nova.virt.block_device [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Booting with volume-backed-image e19384e9-bd8b-46ce-9cf0-3cac8b3d8868 at /dev/vda
Nov 27 03:36:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:36:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:40 user nova-compute[75006]: DEBUG nova.network.neutron [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Successfully created port: 5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Successfully updated port: 5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquired lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-88f26307-b5ef-4cd5-8fa0-baa76a72e85d req-bdb02a7a-535e-4619-bdb1-bb477286687f service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-changed-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-88f26307-b5ef-4cd5-8fa0-baa76a72e85d req-bdb02a7a-535e-4619-bdb1-bb477286687f service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Refreshing instance network info cache due to event network-changed-5c7595e4-d17a-4894-be14-84875dd85457. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-88f26307-b5ef-4cd5-8fa0-baa76a72e85d req-bdb02a7a-535e-4619-bdb1-bb477286687f service nova] Acquiring lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Updating instance_info_cache with network_info: [{"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Releasing lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance network_info: |[{"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-88f26307-b5ef-4cd5-8fa0-baa76a72e85d req-bdb02a7a-535e-4619-bdb1-bb477286687f service nova] Acquired lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:36:41 user nova-compute[75006]: DEBUG nova.network.neutron [req-88f26307-b5ef-4cd5-8fa0-baa76a72e85d req-bdb02a7a-535e-4619-bdb1-bb477286687f service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Refreshing network info cache for port 5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:36:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-88f26307-b5ef-4cd5-8fa0-baa76a72e85d req-bdb02a7a-535e-4619-bdb1-bb477286687f service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Updated VIF entry in instance network info cache for port 5c7595e4-d17a-4894-be14-84875dd85457. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:36:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-88f26307-b5ef-4cd5-8fa0-baa76a72e85d req-bdb02a7a-535e-4619-bdb1-bb477286687f service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Updating instance_info_cache with network_info: [{"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-88f26307-b5ef-4cd5-8fa0-baa76a72e85d req-bdb02a7a-535e-4619-bdb1-bb477286687f service nova] Releasing lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:36:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:45 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6b291b73-1b23-415a-ae61-f994d6e33d7e is timed out.
Nov 27 03:36:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Successfully detached device vdb from instance 6b291b73-1b23-415a-ae61-f994d6e33d7e from the live domain config.
Nov 27 03:36:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hEeSXURa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:36:45 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b3ea7e-be5e-4eed-91c2-1b1456536791]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:36:45 user nova-compute[75006]: No targets found.
Nov 27 03:36:45 user nova-compute[75006]: iSNS:
Nov 27 03:36:45 user nova-compute[75006]: No targets found.
Nov 27 03:36:45 user nova-compute[75006]: STATIC:
Nov 27 03:36:45 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47
Nov 27 03:36:45 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:36:45 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:36:45 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:36:45 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:36:45 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:36:45 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5
Nov 27 03:36:45 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:36:45 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:36:45 user nova-compute[75006]: FIRMWARE:
Nov 27 03:36:45 user nova-compute[75006]: No targets found.
Nov 27 03:36:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:36:45 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:36:45 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850bc30-5488-465b-8f6c-a9eeb2447264]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f382d857-df68-4026-83ad-6aee1d921a29]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:36:45 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:36:45 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:36:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:36:45 user nova-compute[75006]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 (non-flash)
Nov 27 03:36:45 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:36:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4247b43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.utils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[509a4ed8-a25c-4e2c-8b0c-39dec102fca8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef43b4-b84c-407b-a5fb-96fb756b8658]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae1275-ecd9-49a8-8486-c43e43e652a6]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a35d677-3f09-4363-a820-f58257840009]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[59668207-e789-4969-8c01-dba9d8a27f1e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51bf12e-4e2c-4e68-a000-1a03848f99cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97c4199-fb5b-4878-a462-ad7e58f20c45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f68a8-7465-467d-90b8-9286d1acd18c]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:36:45 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9dc695-68f2-49c4-9c04-9286203c79eb]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.utils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Updating existing volume attachment record: 0bd11e58-d538-49c3-b237-ee60eb48be1a {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e671250d-f3a4-4859-9159-d7c493c9e461]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dc1f5e-1eaf-4143-91fc-4d77ce56974e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5, portal: 172.16.0.220,3260]
Nov 27 03:36:45 user nova-compute[75006]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5, portal: 172.16.0.220,3260] successful.
Nov 27 03:36:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:783cb71c-489b-4a70-8c97-3fdd6afba4f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1f1146-4338-4774-b8e7-63ffa3d877d2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] <== disconnect_volume: return (327ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:36:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:36:46 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'flavor' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:36:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6a20f438-0135-4cd8-8b57-e321b9e49ebf tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.698s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:47 user nova-compute[75006]: INFO nova.compute.manager [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Terminating instance
Nov 27 03:36:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-d43c0a88-e9db-475f-a8ea-9905ff09ba9e req-93028103-1298-4292-99a8-d94bbb3bf2a8 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-unplugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d43c0a88-e9db-475f-a8ea-9905ff09ba9e req-93028103-1298-4292-99a8-d94bbb3bf2a8 service nova] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d43c0a88-e9db-475f-a8ea-9905ff09ba9e req-93028103-1298-4292-99a8-d94bbb3bf2a8 service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d43c0a88-e9db-475f-a8ea-9905ff09ba9e req-93028103-1298-4292-99a8-d94bbb3bf2a8 service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-d43c0a88-e9db-475f-a8ea-9905ff09ba9e req-93028103-1298-4292-99a8-d94bbb3bf2a8 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] No waiting events found dispatching network-vif-unplugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-d43c0a88-e9db-475f-a8ea-9905ff09ba9e req-93028103-1298-4292-99a8-d94bbb3bf2a8 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-unplugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Instance destroyed successfully.
Nov 27 03:36:48 user nova-compute[75006]: DEBUG nova.objects.instance [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lazy-loading 'resources' on Instance uuid f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-365957293',display_name='tempest-VolumesActionsTest-instance-365957293',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-365957293',id=40,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:35:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67aa5c34f5fb4c07a266ad0aa94d26f7',ramdisk_id='',reservation_id='r-5wv79nmp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-535517367',owner_user_name='tempest-VolumesActionsTest-535517367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:35:04Z,user_data=None,user_id='46cd9289539949318955d507a4b12276',uuid=f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converting VIF {"id": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "address": "fa:16:3e:7e:14:47", "network": {"id": "314e0e2f-65bc-4bfd-bcee-f24b02a38a52", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1008604332-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67aa5c34f5fb4c07a266ad0aa94d26f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a31dbec-cc", "ovs_interfaceid": "7a31dbec-cc00-4001-8b62-6752e35d2ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:47,bridge_name='br-int',has_traffic_filtering=True,id=7a31dbec-cc00-4001-8b62-6752e35d2ca0,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a31dbec-cc') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG os_vif [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:47,bridge_name='br-int',has_traffic_filtering=True,id=7a31dbec-cc00-4001-8b62-6752e35d2ca0,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a31dbec-cc') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a31dbec-cc, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1692e4b6-bc02-4adc-92d9-b32ae12c3130) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: INFO os_vif [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:14:47,bridge_name='br-int',has_traffic_filtering=True,id=7a31dbec-cc00-4001-8b62-6752e35d2ca0,network=Network(314e0e2f-65bc-4bfd-bcee-f24b02a38a52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a31dbec-cc')
Nov 27 03:36:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Deleting instance files /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1_del
Nov 27 03:36:48 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Deletion of /opt/stack/data/nova/instances/f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1_del complete
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: INFO nova.compute.manager [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 27 03:36:48 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:48 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Took 0.44 seconds to deallocate network for instance.
Nov 27 03:36:48 user nova-compute[75006]: DEBUG nova.compute.manager [req-d2db10f9-e14f-4ea3-8e4f-9ac8a189c392 req-646a6319-8bce-4688-85ec-d555c69b28f2 service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-deleted-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:49 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Deleted allocations for instance f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a63ae048-a61e-44fc-ba57-7f92326746b9 tempest-VolumesActionsTest-535517367 tempest-VolumesActionsTest-535517367-project-member] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] No waiting events found dispatching network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:49 user nova-compute[75006]: WARNING nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received unexpected event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 for instance with vm_state deleted and task_state None.
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] No waiting events found dispatching network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:49 user nova-compute[75006]: WARNING nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received unexpected event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 for instance with vm_state deleted and task_state None.
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] No waiting events found dispatching network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:49 user nova-compute[75006]: WARNING nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received unexpected event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 for instance with vm_state deleted and task_state None.
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Acquiring lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] Lock "f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] No waiting events found dispatching network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:49 user nova-compute[75006]: WARNING nova.compute.manager [req-b2a3fcfd-527b-44a6-89ba-457a3074a961 req-2fdce22f-0e47-4027-9e76-c964c2fc2c0a service nova] [instance: f38d8b8a-7f58-4b1c-8b4c-f5168f53e9c1] Received unexpected event network-vif-plugged-7a31dbec-cc00-4001-8b62-6752e35d2ca0 for instance with vm_state deleted and task_state None.
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:36:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Creating image(s)
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Ensure instance console log exists: /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Start _get_guest_xml network_info=[{"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '0bd11e58-d538-49c3-b237-ee60eb48be1a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtamYupB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ae5f39a-0c6d-4538-b358-1eb6c753f442', 'attached_at': '', 'detached_at': '', 'volume_id': '31cb72e8-aee3-4768-abf3-2c010176a4ba', 'serial': '31cb72e8-aee3-4768-abf3-2c010176a4ba'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:36:51 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:36:51 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtamYupB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:36:51 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:36:51 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:36:51 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[485684a7-9fce-482b-87e4-6ef0646d61e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:36:51 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[24609664-1cec-4524-affe-3f9e6ca7eb95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba] added
Nov 27 03:36:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cf1169-a0ef-46ef-b6c3-75b1430b19b8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fd3774-5f75-49b9-aae2-732a42628e7f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtamYupB {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtamYupB" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ccf866-4e09-47b6-9305-849f9be77d80]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DtamYupB'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe1c394-2342-4e96-a603-cc08f22dbcd6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c964725-6ac2-4f81-b95a-a9b88d26572d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:36:51 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:36:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:36:51 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:36:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:36:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4656bc8e-e8dc-46c9-aa64-16085c364fa7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba, portal: 172.16.0.220,3260]
Nov 27 03:36:52 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba, portal: 172.16.0.220,3260] successful.
Nov 27 03:36:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d4975b-2e48-42d8-93b1-e4d5b272c3c4]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[427047da-0db5-4239-bd6b-722f106aee22]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:36:52 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:36:52 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:36:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:36:52 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:36:52 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:36:52 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51d449c-b598-409a-91ec-162485818f8c]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:36:52 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtamYupB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23238316239613961', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238316239613961', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1452538442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1452538442',id=42,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-kdywof2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:36:40Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=6ae5f39a-0c6d-4538-b358-1eb6c753f442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:0c:56,bridge_name='br-int',has_traffic_filtering=True,id=5c7595e4-d17a-4894-be14-84875dd85457,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7595e4-d1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.objects.instance [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:36:53 user nova-compute[75006]:   <uuid>6ae5f39a-0c6d-4538-b358-1eb6c753f442</uuid>
Nov 27 03:36:53 user nova-compute[75006]:   <name>instance-0000002a</name>
Nov 27 03:36:53 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:36:53 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:36:53 user nova-compute[75006]:   <metadata>
Nov 27 03:36:53 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:36:53 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:36:53 user nova-compute[75006]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1452538442</nova:name>
Nov 27 03:36:53 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:36:51</nova:creationTime>
Nov 27 03:36:53 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:36:53 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:36:53 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:36:53 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:36:53 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:36:53 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:36:53 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:36:53 user nova-compute[75006]:       <nova:owner>
Nov 27 03:36:53 user nova-compute[75006]:         <nova:user uuid="7bdc7ee98a95432d96679fc697b7d61d">tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member</nova:user>
Nov 27 03:36:53 user nova-compute[75006]:         <nova:project uuid="03bbdcea84574886bbea67eefc84dca0">tempest-ServerBootFromVolumeStableRescueTest-2135085811</nova:project>
Nov 27 03:36:53 user nova-compute[75006]:       </nova:owner>
Nov 27 03:36:53 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:36:53 user nova-compute[75006]:       <nova:ports>
Nov 27 03:36:53 user nova-compute[75006]:         <nova:port uuid="5c7595e4-d17a-4894-be14-84875dd85457">
Nov 27 03:36:53 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 03:36:53 user nova-compute[75006]:         </nova:port>
Nov 27 03:36:53 user nova-compute[75006]:       </nova:ports>
Nov 27 03:36:53 user nova-compute[75006]:     </nova:instance>
Nov 27 03:36:53 user nova-compute[75006]:   </metadata>
Nov 27 03:36:53 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:36:53 user nova-compute[75006]:     <system>
Nov 27 03:36:53 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:36:53 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:36:53 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:36:53 user nova-compute[75006]:       <entry name="serial">6ae5f39a-0c6d-4538-b358-1eb6c753f442</entry>
Nov 27 03:36:53 user nova-compute[75006]:       <entry name="uuid">6ae5f39a-0c6d-4538-b358-1eb6c753f442</entry>
Nov 27 03:36:53 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:36:53 user nova-compute[75006]:     </system>
Nov 27 03:36:53 user nova-compute[75006]:   </sysinfo>
Nov 27 03:36:53 user nova-compute[75006]:   <os>
Nov 27 03:36:53 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:36:53 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:36:53 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:36:53 user nova-compute[75006]:   </os>
Nov 27 03:36:53 user nova-compute[75006]:   <features>
Nov 27 03:36:53 user nova-compute[75006]:     <acpi/>
Nov 27 03:36:53 user nova-compute[75006]:     <apic/>
Nov 27 03:36:53 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:36:53 user nova-compute[75006]:   </features>
Nov 27 03:36:53 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:36:53 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:36:53 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:36:53 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:36:53 user nova-compute[75006]:   </clock>
Nov 27 03:36:53 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:36:53 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:36:53 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:36:53 user nova-compute[75006]:   </cpu>
Nov 27 03:36:53 user nova-compute[75006]:   <devices>
Nov 27 03:36:53 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:36:53 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:36:53 user nova-compute[75006]:       <source dev="/dev/sdb"/>
Nov 27 03:36:53 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:36:53 user nova-compute[75006]:       <serial>31cb72e8-aee3-4768-abf3-2c010176a4ba</serial>
Nov 27 03:36:53 user nova-compute[75006]:     </disk>
Nov 27 03:36:53 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:36:53 user nova-compute[75006]:       <mac address="fa:16:3e:a2:0c:56"/>
Nov 27 03:36:53 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:36:53 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:36:53 user nova-compute[75006]:       <target dev="tap5c7595e4-d1"/>
Nov 27 03:36:53 user nova-compute[75006]:     </interface>
Nov 27 03:36:53 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:36:53 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/console.log" append="off"/>
Nov 27 03:36:53 user nova-compute[75006]:     </serial>
Nov 27 03:36:53 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:36:53 user nova-compute[75006]:     <video>
Nov 27 03:36:53 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:36:53 user nova-compute[75006]:     </video>
Nov 27 03:36:53 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:36:53 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:36:53 user nova-compute[75006]:     </rng>
Nov 27 03:36:53 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:36:53 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:36:53 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:36:53 user nova-compute[75006]:     </memballoon>
Nov 27 03:36:53 user nova-compute[75006]:   </devices>
Nov 27 03:36:53 user nova-compute[75006]: </domain>
Nov 27 03:36:53 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1452538442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1452538442',id=42,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-kdywof2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:36:40Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=6ae5f39a-0c6d-4538-b358-1eb6c753f442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:0c:56,bridge_name='br-int',has_traffic_filtering=True,id=5c7595e4-d17a-4894-be14-84875dd85457,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7595e4-d1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG os_vif [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:0c:56,bridge_name='br-int',has_traffic_filtering=True,id=5c7595e4-d17a-4894-be14-84875dd85457,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7595e4-d1') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '929e9e42-0801-5556-be8a-adfa9e0f0871', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c7595e4-d1, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c7595e4-d1, col_values=(('qos', UUID('d608d860-f1cc-4fe2-962f-1be6ade92067')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c7595e4-d1, col_values=(('external_ids', {'iface-id': '5c7595e4-d17a-4894-be14-84875dd85457', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:0c:56', 'vm-uuid': '6ae5f39a-0c6d-4538-b358-1eb6c753f442'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:53 user nova-compute[75006]: INFO os_vif [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:0c:56,bridge_name='br-int',has_traffic_filtering=True,id=5c7595e4-d17a-4894-be14-84875dd85457,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7595e4-d1')
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:36:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No VIF found with MAC fa:16:3e:a2:0c:56, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-16f60af3-27e7-4394-8534-8ca35053cb36 req-5167eca1-d54b-4101-8d5f-1791b25d1932 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-16f60af3-27e7-4394-8534-8ca35053cb36 req-5167eca1-d54b-4101-8d5f-1791b25d1932 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-16f60af3-27e7-4394-8534-8ca35053cb36 req-5167eca1-d54b-4101-8d5f-1791b25d1932 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-16f60af3-27e7-4394-8534-8ca35053cb36 req-5167eca1-d54b-4101-8d5f-1791b25d1932 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-16f60af3-27e7-4394-8534-8ca35053cb36 req-5167eca1-d54b-4101-8d5f-1791b25d1932 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:54 user nova-compute[75006]: WARNING nova.compute.manager [req-16f60af3-27e7-4394-8534-8ca35053cb36 req-5167eca1-d54b-4101-8d5f-1791b25d1932 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state building and task_state spawning.
Nov 27 03:36:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:36:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance spawned successfully.
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:36:56 user nova-compute[75006]: INFO nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:36:56 user nova-compute[75006]: INFO nova.compute.manager [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Took 17.56 seconds to build instance.
Nov 27 03:36:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-60d33ee8-3c5b-413d-a650-3ae6ec13d620 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.657s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:56 user nova-compute[75006]: WARNING nova.compute.manager [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state active and task_state None.
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-changed-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Refreshing instance network info cache due to event network-changed-eaa6a3ce-8452-4582-ad29-df86bdf610aa. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] Acquiring lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] Acquired lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:36:56 user nova-compute[75006]: DEBUG nova.network.neutron [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Refreshing network info cache for port eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:36:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updated VIF entry in instance network info cache for port eaa6a3ce-8452-4582-ad29-df86bdf610aa. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:36:57 user nova-compute[75006]: DEBUG nova.network.neutron [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating instance_info_cache with network_info: [{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:36:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8eb2366f-3da5-4a25-9cc7-e8497b225a6b req-64d1ffc8-630f-4699-8d38-f11c1e9e0368 service nova] Releasing lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:36:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:36:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:58 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:36:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:59 user nova-compute[75006]: INFO nova.compute.manager [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Shelving
Nov 27 03:36:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:36:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance destroyed successfully.
Nov 27 03:36:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-ddf08fc8-2fc1-4d19-a154-85657e3f35cb req-4707217c-d927-4650-9eb5-e856d0347bfe service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-unplugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ddf08fc8-2fc1-4d19-a154-85657e3f35cb req-4707217c-d927-4650-9eb5-e856d0347bfe service nova] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ddf08fc8-2fc1-4d19-a154-85657e3f35cb req-4707217c-d927-4650-9eb5-e856d0347bfe service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ddf08fc8-2fc1-4d19-a154-85657e3f35cb req-4707217c-d927-4650-9eb5-e856d0347bfe service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-ddf08fc8-2fc1-4d19-a154-85657e3f35cb req-4707217c-d927-4650-9eb5-e856d0347bfe service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] No waiting events found dispatching network-vif-unplugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:36:59 user nova-compute[75006]: WARNING nova.compute.manager [req-ddf08fc8-2fc1-4d19-a154-85657e3f35cb req-4707217c-d927-4650-9eb5-e856d0347bfe service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received unexpected event network-vif-unplugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa for instance with vm_state active and task_state shelving.
Nov 27 03:36:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Beginning cold snapshot process
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:36:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk /opt/stack/data/nova/instances/snapshots/tmpqwnzs66s/ddd3470a3a624f438181f624bcedf471 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk /opt/stack/data/nova/instances/snapshots/tmpqwnzs66s/ddd3470a3a624f438181f624bcedf471" returned: 0 in 1.146s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:01 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Snapshot extracted, beginning image upload
Nov 27 03:37:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-2337a048-78d5-40c1-8665-e170e4316652 req-47623cd3-d360-4c86-8459-64f6099b5d9a service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2337a048-78d5-40c1-8665-e170e4316652 req-47623cd3-d360-4c86-8459-64f6099b5d9a service nova] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2337a048-78d5-40c1-8665-e170e4316652 req-47623cd3-d360-4c86-8459-64f6099b5d9a service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2337a048-78d5-40c1-8665-e170e4316652 req-47623cd3-d360-4c86-8459-64f6099b5d9a service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-2337a048-78d5-40c1-8665-e170e4316652 req-47623cd3-d360-4c86-8459-64f6099b5d9a service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] No waiting events found dispatching network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:37:01 user nova-compute[75006]: WARNING nova.compute.manager [req-2337a048-78d5-40c1-8665-e170e4316652 req-47623cd3-d360-4c86-8459-64f6099b5d9a service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received unexpected event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:37:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7861MB free_disk=25.037761688232422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6b291b73-1b23-415a-ae61-f994d6e33d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 326427b4-70bc-49e0-ae50-b8daf2c3421a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6ae5f39a-0c6d-4538-b358-1eb6c753f442 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:37:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:03 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Snapshot image upload complete
Nov 27 03:37:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:37:04 user nova-compute[75006]: INFO nova.compute.manager [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Shelve offloading
Nov 27 03:37:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance destroyed successfully.
Nov 27 03:37:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:37:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:37:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquired lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:37:04 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:37:04 user nova-compute[75006]: DEBUG nova.network.neutron [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating instance_info_cache with network_info: [{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:37:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Releasing lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:37:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance destroyed successfully.
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'resources' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895041011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895041011',id=41,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJme53BRSXGv3FeW1R3zk9QGe+0Jem0+Jlf8BC9dvh0w+itxwcCsWMDyK6Am6GIFd5Qrn90XKlHZNkRy+MEGyAVQNFerPfmm0gojGtZ13OJJwnz4rXkcqx3ty1FaH+EjTg==',key_name='tempest-keypair-1897998770',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:35:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-umhbpt7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member',shelved_at='2023-11-27T03:37:03.989301',shelved_host='user',shelved_image_id='a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=326427b4-70bc-49e0-ae50-b8daf2c3421a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG os_vif [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaa6a3ce-84, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-84d59812-e47a-4280-bdf8-eaf7957debdf req-fc9ec9f7-a3e7-42ec-8dca-350daaf37d19 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-changed-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-84d59812-e47a-4280-bdf8-eaf7957debdf req-fc9ec9f7-a3e7-42ec-8dca-350daaf37d19 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Refreshing instance network info cache due to event network-changed-eaa6a3ce-8452-4582-ad29-df86bdf610aa. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-84d59812-e47a-4280-bdf8-eaf7957debdf req-fc9ec9f7-a3e7-42ec-8dca-350daaf37d19 service nova] Acquiring lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-84d59812-e47a-4280-bdf8-eaf7957debdf req-fc9ec9f7-a3e7-42ec-8dca-350daaf37d19 service nova] Acquired lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-84d59812-e47a-4280-bdf8-eaf7957debdf req-fc9ec9f7-a3e7-42ec-8dca-350daaf37d19 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Refreshing network info cache for port eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66f447b4-befc-4f46-bbeb-4db96872126d) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:05 user nova-compute[75006]: INFO os_vif [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84')
Nov 27 03:37:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Deleting instance files /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a_del
Nov 27 03:37:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Deletion of /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a_del complete
Nov 27 03:37:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:05 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Deleted allocations for instance 326427b4-70bc-49e0-ae50-b8daf2c3421a
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.objects.instance [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'numa_topology' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.objects.base [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<326427b4-70bc-49e0-ae50-b8daf2c3421a> lazy-loaded attributes: resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-84d59812-e47a-4280-bdf8-eaf7957debdf req-fc9ec9f7-a3e7-42ec-8dca-350daaf37d19 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updated VIF entry in instance network info cache for port eaa6a3ce-8452-4582-ad29-df86bdf610aa. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-84d59812-e47a-4280-bdf8-eaf7957debdf req-fc9ec9f7-a3e7-42ec-8dca-350daaf37d19 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating instance_info_cache with network_info: [{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-84d59812-e47a-4280-bdf8-eaf7957debdf req-fc9ec9f7-a3e7-42ec-8dca-350daaf37d19 service nova] Releasing lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:37:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-c4550c16-9713-4daa-9852-4ae338c09600 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.767s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updating instance_info_cache with network_info: [{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:37:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:37:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:37:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:37:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:37:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:37:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:37:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:37:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:13 user nova-compute[75006]: INFO nova.compute.manager [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Detaching volume 24312365-c85b-476a-820e-8b1bbe2dfa47
Nov 27 03:37:13 user nova-compute[75006]: INFO nova.virt.block_device [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Attempting to driver detach volume 24312365-c85b-476a-820e-8b1bbe2dfa47 from mountpoint /dev/vdb
Nov 27 03:37:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Attempting to detach device vdb from instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:37:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:37:13 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:37:13 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:37:13 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:37:13 user nova-compute[75006]:   <serial>24312365-c85b-476a-820e-8b1bbe2dfa47</serial>
Nov 27 03:37:13 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 03:37:13 user nova-compute[75006]: </disk>
Nov 27 03:37:13 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:37:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully detached device vdb from instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f from the persistent domain config.
Nov 27 03:37:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:37:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:37:13 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:37:13 user nova-compute[75006]:   <source dev="/dev/sde"/>
Nov 27 03:37:13 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:37:13 user nova-compute[75006]:   <serial>24312365-c85b-476a-820e-8b1bbe2dfa47</serial>
Nov 27 03:37:13 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 03:37:13 user nova-compute[75006]: </disk>
Nov 27 03:37:13 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:37:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:15 user nova-compute[75006]: INFO nova.compute.manager [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Terminating instance
Nov 27 03:37:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-b4292183-fb53-4d12-b8aa-ac182d0cea17 req-c3e91fdf-d43a-493c-b882-442e5a4e4f5e service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b4292183-fb53-4d12-b8aa-ac182d0cea17 req-c3e91fdf-d43a-493c-b882-442e5a4e4f5e service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b4292183-fb53-4d12-b8aa-ac182d0cea17 req-c3e91fdf-d43a-493c-b882-442e5a4e4f5e service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b4292183-fb53-4d12-b8aa-ac182d0cea17 req-c3e91fdf-d43a-493c-b882-442e5a4e4f5e service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-b4292183-fb53-4d12-b8aa-ac182d0cea17 req-c3e91fdf-d43a-493c-b882-442e5a4e4f5e service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-b4292183-fb53-4d12-b8aa-ac182d0cea17 req-c3e91fdf-d43a-493c-b882-442e5a4e4f5e service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-unplugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:37:15 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Instance destroyed successfully.
Nov 27 03:37:15 user nova-compute[75006]: DEBUG nova.objects.instance [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'resources' on Instance uuid 6b291b73-1b23-415a-ae61-f994d6e33d7e {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-32047452',display_name='tempest-ServerRescueNegativeTestJSON-server-32047452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-32047452',id=34,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4gqSavu/0+EshxWYO2Gl7WlMV6CsX979Tv3dWfmDW218WUXmQEX88lY8YM5vbXjzZ6oatayWjI3POVeLYOzNGGgyXX9jWgt3r1ix5SHG/ItK3E3AZfrZvKSFwpdm2UOA==',key_name='tempest-keypair-892943442',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:32:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-40sm8ndr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='797a8975406044ddabaad6e23950a71b',uuid=6b291b73-1b23-415a-ae61-f994d6e33d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "address": "fa:16:3e:64:05:65", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc740fe-93", "ovs_interfaceid": "1fc740fe-93b7-49bc-8136-86b411ec34c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:05:65,bridge_name='br-int',has_traffic_filtering=True,id=1fc740fe-93b7-49bc-8136-86b411ec34c0,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc740fe-93') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG os_vif [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:05:65,bridge_name='br-int',has_traffic_filtering=True,id=1fc740fe-93b7-49bc-8136-86b411ec34c0,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc740fe-93') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fc740fe-93, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc74f0ce-9ef0-4bf4-8e7d-1ccbf5874328) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:37:15 user nova-compute[75006]: INFO os_vif [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:05:65,bridge_name='br-int',has_traffic_filtering=True,id=1fc740fe-93b7-49bc-8136-86b411ec34c0,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc740fe-93')
Nov 27 03:37:15 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Deleting instance files /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e_del
Nov 27 03:37:15 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Deletion of /opt/stack/data/nova/instances/6b291b73-1b23-415a-ae61-f994d6e33d7e_del complete
Nov 27 03:37:16 user nova-compute[75006]: INFO nova.compute.manager [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 27 03:37:16 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:37:16 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:37:16 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:37:16 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:37:16 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Took 0.79 seconds to deallocate network for instance.
Nov 27 03:37:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-2d1f9483-b240-467b-a29b-1aa4ff35de54 req-a26acab0-c8e3-4c9d-8b5e-df33143fd2a0 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-deleted-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:37:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:17 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:37:17 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:37:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:17 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Deleted allocations for instance 6b291b73-1b23-415a-ae61-f994d6e33d7e
Nov 27 03:37:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-dd34323e-b308-46d2-b523-a4da01296b74 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-f04cb4f8-a4d3-494e-9c9b-ee9f12fc36d7 req-662d3c60-86ab-44c0-ac23-a3cd97f172b2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:37:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f04cb4f8-a4d3-494e-9c9b-ee9f12fc36d7 req-662d3c60-86ab-44c0-ac23-a3cd97f172b2 service nova] Acquiring lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f04cb4f8-a4d3-494e-9c9b-ee9f12fc36d7 req-662d3c60-86ab-44c0-ac23-a3cd97f172b2 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f04cb4f8-a4d3-494e-9c9b-ee9f12fc36d7 req-662d3c60-86ab-44c0-ac23-a3cd97f172b2 service nova] Lock "6b291b73-1b23-415a-ae61-f994d6e33d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-f04cb4f8-a4d3-494e-9c9b-ee9f12fc36d7 req-662d3c60-86ab-44c0-ac23-a3cd97f172b2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] No waiting events found dispatching network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:37:17 user nova-compute[75006]: WARNING nova.compute.manager [req-f04cb4f8-a4d3-494e-9c9b-ee9f12fc36d7 req-662d3c60-86ab-44c0-ac23-a3cd97f172b2 service nova] [instance: 6b291b73-1b23-415a-ae61-f994d6e33d7e] Received unexpected event network-vif-plugged-1fc740fe-93b7-49bc-8136-86b411ec34c0 for instance with vm_state deleted and task_state None.
Nov 27 03:37:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:33 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f is timed out.
Nov 27 03:37:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully detached device vdb from instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f from the live domain config.
Nov 27 03:37:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJnXuKhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:37:33 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf250b17-9002-4114-be9f-4e6c540b141f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:37:33 user nova-compute[75006]: No targets found.
Nov 27 03:37:33 user nova-compute[75006]: iSNS:
Nov 27 03:37:33 user nova-compute[75006]: No targets found.
Nov 27 03:37:33 user nova-compute[75006]: STATIC:
Nov 27 03:37:33 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba
Nov 27 03:37:33 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:37:33 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:37:33 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47
Nov 27 03:37:33 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:37:33 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:37:33 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:37:33 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:37:33 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:37:33 user nova-compute[75006]: FIRMWARE:
Nov 27 03:37:33 user nova-compute[75006]: No targets found.
Nov 27 03:37:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:37:33 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:37:33 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04e6d40-336a-414e-aefa-017d54c7e9dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[683192dc-dfa3-41cb-87a8-f9eb5098ce6a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:37:33 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:37:33 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:37:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:37:33 user nova-compute[75006]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 (non-flash)
Nov 27 03:37:33 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:37:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4007468c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8538561a-ecb2-4b2b-a8da-bdcea7bf3401]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[35832afc-adef-4500-af00-898afb396641]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8ccd5e-e425-455a-a25a-96ee77204b5c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8391dc04-6471-4b7a-93a8-a04d5d58a182]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0930f275-6e45-4741-a88e-78580fa338c7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace04fc-bc17-4df7-b500-0446f05ac26a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260]
Nov 27 03:37:33 user nova-compute[75006]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47, portal: 172.16.0.220,3260] successful.
Nov 27 03:37:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24312365-c85b-476a-820e-8b1bbe2dfa47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e676090-7481-4e9b-a0f1-3553fb5e5bf8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== disconnect_volume: return (315ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:37:34 user nova-compute[75006]: INFO nova.compute.claims [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Claim successful on node user
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:37:34 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:37:34 user nova-compute[75006]: INFO nova.virt.block_device [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Booting with volume 379896da-5199-47cc-a10f-76591d46132a at /dev/vda
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.policy [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee3d2a74e8748c1aa045cc93d4894e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b1b7443dc44f21ac89452277f326b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG os_brick.utils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55b408b-8d97-40fb-8d46-23c5f98305bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad030742-be5c-4e63-a098-590c92bacf6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'flavor' on Instance uuid 5449b27f-2795-4ab6-a965-bdbbe9a9a59f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513a87f-ffb4-4af3-8dd1-5d8aff0a3806]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[99857064-8df6-45f9-bb4f-ab2c3de52708]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:37:34 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd741cca-41ab-4eff-93ee-b0b5e3e2312d]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG os_brick.utils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Updating existing volume attachment record: c6140562-36e2-404d-9100-a4f3bdc70dab {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:37:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3cc01fd8-6556-4ba4-84a3-53f6c38d8321 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.912s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:35 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Successfully created port: 007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:37:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Successfully updated port: 007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquired lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-28962f28-ac94-4408-b197-e8feb1246f75 req-e7717414-34c2-4ee8-a3ba-5870c6edf72a service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received event network-changed-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-28962f28-ac94-4408-b197-e8feb1246f75 req-e7717414-34c2-4ee8-a3ba-5870c6edf72a service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Refreshing instance network info cache due to event network-changed-007cf0a9-821e-4da0-99b6-6b4f7ced9c83. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-28962f28-ac94-4408-b197-e8feb1246f75 req-e7717414-34c2-4ee8-a3ba-5870c6edf72a service nova] Acquiring lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Updating instance_info_cache with network_info: [{"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Releasing lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Instance network_info: |[{"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-28962f28-ac94-4408-b197-e8feb1246f75 req-e7717414-34c2-4ee8-a3ba-5870c6edf72a service nova] Acquired lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.network.neutron [req-28962f28-ac94-4408-b197-e8feb1246f75 req-e7717414-34c2-4ee8-a3ba-5870c6edf72a service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Refreshing network info cache for port 007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.network.neutron [req-28962f28-ac94-4408-b197-e8feb1246f75 req-e7717414-34c2-4ee8-a3ba-5870c6edf72a service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Updated VIF entry in instance network info cache for port 007cf0a9-821e-4da0-99b6-6b4f7ced9c83. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG nova.network.neutron [req-28962f28-ac94-4408-b197-e8feb1246f75 req-e7717414-34c2-4ee8-a3ba-5870c6edf72a service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Updating instance_info_cache with network_info: [{"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:37:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-28962f28-ac94-4408-b197-e8feb1246f75 req-e7717414-34c2-4ee8-a3ba-5870c6edf72a service nova] Releasing lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:37:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:37:41 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Creating image(s)
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Ensure instance console log exists: /opt/stack/data/nova/instances/84bc03ca-6487-4dcd-b16d-816eb3b3a3ba/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Start _get_guest_xml network_info=[{"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'c6140562-36e2-404d-9100-a4f3bdc70dab', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jhzmJLCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84bc03ca-6487-4dcd-b16d-816eb3b3a3ba', 'attached_at': '', 'detached_at': '', 'volume_id': '379896da-5199-47cc-a10f-76591d46132a', 'serial': '379896da-5199-47cc-a10f-76591d46132a'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:37:41 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:37:41 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jhzmJLCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:37:41 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:37:41 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:37:41 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0ce7d5-d318-4baf-afc7-f8021b5cfda3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:37:41 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032ab40-0deb-486f-b2e2-f891093d9bdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a] added
Nov 27 03:37:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef17e70-4011-4967-8503-7ca54da68fb7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19cd469-9c45-4070-a651-09d1d281cffe]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jhzmJLCd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jhzmJLCd" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[099602ff-212b-4401-b7cd-e91dca68f2bd]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jhzmJLCd'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[84370f6f-fa69-40c2-9247-142b1ab029e3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb373c40-c2d5-4ea4-9181-19398dac0029]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:37:41 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:37:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:37:41 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:37:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce5782d-cc7e-4f5f-9fc3-6707bbf5b3e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a, portal: 172.16.0.220,3260]
Nov 27 03:37:41 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a, portal: 172.16.0.220,3260] successful.
Nov 27 03:37:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e57278-3e81-486f-b027-fd9f58caf4a6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3489496-0f0f-4701-8626-3a05d09da7c6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:37:41 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:37:41 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:37:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:37:41 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:37:41 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:37:41 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943c1dd-771c-4a6f-8969-7715874ebd66]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:37:41 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jhzmJLCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26131323339373362', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131323339373362', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1369048475',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1369048475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1369048475',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbTOjDJ5EVtbIZar5KCvTnfcDIf0qaHR3xmyZKacwXRpGk3LJKSKOHW1gkCzh3q4CKyQMDTBObzHHDzIhN6f0PDyWSD7HAREE47Q5xrCVv1xpE4aiMdKxwmMqsXYlE9Fg==',key_name='tempest-keypair-1622692034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-9nxlm3h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=84bc03ca-6487-4dcd-b16d-816eb3b3a3ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b9:76,bridge_name='br-int',has_traffic_filtering=True,id=007cf0a9-821e-4da0-99b6-6b4f7ced9c83,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cf0a9-82') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'pci_devices' on Instance uuid 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:37:42 user nova-compute[75006]:   <uuid>84bc03ca-6487-4dcd-b16d-816eb3b3a3ba</uuid>
Nov 27 03:37:42 user nova-compute[75006]:   <name>instance-0000002b</name>
Nov 27 03:37:42 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:37:42 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:37:42 user nova-compute[75006]:   <metadata>
Nov 27 03:37:42 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:37:42 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:37:42 user nova-compute[75006]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1369048475</nova:name>
Nov 27 03:37:42 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:37:41</nova:creationTime>
Nov 27 03:37:42 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:37:42 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:37:42 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:37:42 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:37:42 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:37:42 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:37:42 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:37:42 user nova-compute[75006]:       <nova:owner>
Nov 27 03:37:42 user nova-compute[75006]:         <nova:user uuid="bee3d2a74e8748c1aa045cc93d4894e5">tempest-TestVolumeBootPattern-1716945418-project-member</nova:user>
Nov 27 03:37:42 user nova-compute[75006]:         <nova:project uuid="46b1b7443dc44f21ac89452277f326b1">tempest-TestVolumeBootPattern-1716945418</nova:project>
Nov 27 03:37:42 user nova-compute[75006]:       </nova:owner>
Nov 27 03:37:42 user nova-compute[75006]:       <nova:ports>
Nov 27 03:37:42 user nova-compute[75006]:         <nova:port uuid="007cf0a9-821e-4da0-99b6-6b4f7ced9c83">
Nov 27 03:37:42 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 03:37:42 user nova-compute[75006]:         </nova:port>
Nov 27 03:37:42 user nova-compute[75006]:       </nova:ports>
Nov 27 03:37:42 user nova-compute[75006]:     </nova:instance>
Nov 27 03:37:42 user nova-compute[75006]:   </metadata>
Nov 27 03:37:42 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:37:42 user nova-compute[75006]:     <system>
Nov 27 03:37:42 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:37:42 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:37:42 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:37:42 user nova-compute[75006]:       <entry name="serial">84bc03ca-6487-4dcd-b16d-816eb3b3a3ba</entry>
Nov 27 03:37:42 user nova-compute[75006]:       <entry name="uuid">84bc03ca-6487-4dcd-b16d-816eb3b3a3ba</entry>
Nov 27 03:37:42 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:37:42 user nova-compute[75006]:     </system>
Nov 27 03:37:42 user nova-compute[75006]:   </sysinfo>
Nov 27 03:37:42 user nova-compute[75006]:   <os>
Nov 27 03:37:42 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:37:42 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:37:42 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:37:42 user nova-compute[75006]:   </os>
Nov 27 03:37:42 user nova-compute[75006]:   <features>
Nov 27 03:37:42 user nova-compute[75006]:     <acpi/>
Nov 27 03:37:42 user nova-compute[75006]:     <apic/>
Nov 27 03:37:42 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:37:42 user nova-compute[75006]:   </features>
Nov 27 03:37:42 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:37:42 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:37:42 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:37:42 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:37:42 user nova-compute[75006]:   </clock>
Nov 27 03:37:42 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:37:42 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:37:42 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:37:42 user nova-compute[75006]:   </cpu>
Nov 27 03:37:42 user nova-compute[75006]:   <devices>
Nov 27 03:37:42 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:37:42 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:37:42 user nova-compute[75006]:       <source dev="/dev/sdd"/>
Nov 27 03:37:42 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:37:42 user nova-compute[75006]:       <serial>379896da-5199-47cc-a10f-76591d46132a</serial>
Nov 27 03:37:42 user nova-compute[75006]:     </disk>
Nov 27 03:37:42 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:37:42 user nova-compute[75006]:       <mac address="fa:16:3e:e4:b9:76"/>
Nov 27 03:37:42 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:37:42 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:37:42 user nova-compute[75006]:       <target dev="tap007cf0a9-82"/>
Nov 27 03:37:42 user nova-compute[75006]:     </interface>
Nov 27 03:37:42 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:37:42 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/84bc03ca-6487-4dcd-b16d-816eb3b3a3ba/console.log" append="off"/>
Nov 27 03:37:42 user nova-compute[75006]:     </serial>
Nov 27 03:37:42 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:37:42 user nova-compute[75006]:     <video>
Nov 27 03:37:42 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:37:42 user nova-compute[75006]:     </video>
Nov 27 03:37:42 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:37:42 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:37:42 user nova-compute[75006]:     </rng>
Nov 27 03:37:42 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:37:42 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:37:42 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:37:42 user nova-compute[75006]:     </memballoon>
Nov 27 03:37:42 user nova-compute[75006]:   </devices>
Nov 27 03:37:42 user nova-compute[75006]: </domain>
Nov 27 03:37:42 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1369048475',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1369048475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1369048475',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbTOjDJ5EVtbIZar5KCvTnfcDIf0qaHR3xmyZKacwXRpGk3LJKSKOHW1gkCzh3q4CKyQMDTBObzHHDzIhN6f0PDyWSD7HAREE47Q5xrCVv1xpE4aiMdKxwmMqsXYlE9Fg==',key_name='tempest-keypair-1622692034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-9nxlm3h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=84bc03ca-6487-4dcd-b16d-816eb3b3a3ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b9:76,bridge_name='br-int',has_traffic_filtering=True,id=007cf0a9-821e-4da0-99b6-6b4f7ced9c83,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cf0a9-82') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG os_vif [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b9:76,bridge_name='br-int',has_traffic_filtering=True,id=007cf0a9-821e-4da0-99b6-6b4f7ced9c83,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cf0a9-82') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1efe2b1a-2ef8-5178-9f76-1bf447238d42', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007cf0a9-82, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap007cf0a9-82, col_values=(('qos', UUID('b9e48321-badc-4bc4-a8ad-f9e11087d17c')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap007cf0a9-82, col_values=(('external_ids', {'iface-id': '007cf0a9-821e-4da0-99b6-6b4f7ced9c83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:b9:76', 'vm-uuid': '84bc03ca-6487-4dcd-b16d-816eb3b3a3ba'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:42 user nova-compute[75006]: INFO os_vif [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:b9:76,bridge_name='br-int',has_traffic_filtering=True,id=007cf0a9-821e-4da0-99b6-6b4f7ced9c83,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cf0a9-82')
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:37:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No VIF found with MAC fa:16:3e:e4:b9:76, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-4dd6d137-33be-4337-b767-61492ceb829c req-e52bca23-30f0-4d34-bcd7-ab69815718ef service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received event network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4dd6d137-33be-4337-b767-61492ceb829c req-e52bca23-30f0-4d34-bcd7-ab69815718ef service nova] Acquiring lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4dd6d137-33be-4337-b767-61492ceb829c req-e52bca23-30f0-4d34-bcd7-ab69815718ef service nova] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4dd6d137-33be-4337-b767-61492ceb829c req-e52bca23-30f0-4d34-bcd7-ab69815718ef service nova] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-4dd6d137-33be-4337-b767-61492ceb829c req-e52bca23-30f0-4d34-bcd7-ab69815718ef service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] No waiting events found dispatching network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:37:44 user nova-compute[75006]: WARNING nova.compute.manager [req-4dd6d137-33be-4337-b767-61492ceb829c req-e52bca23-30f0-4d34-bcd7-ab69815718ef service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received unexpected event network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 for instance with vm_state building and task_state spawning.
Nov 27 03:37:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:37:46 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Instance spawned successfully.
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:37:46 user nova-compute[75006]: INFO nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:37:46 user nova-compute[75006]: INFO nova.compute.manager [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Took 12.34 seconds to build instance.
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-1f9ed0e5-f25e-4689-8333-1c983950cf2a req-c589781b-9b51-48cc-886b-ee9cd08d7db9 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received event network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1f9ed0e5-f25e-4689-8333-1c983950cf2a req-c589781b-9b51-48cc-886b-ee9cd08d7db9 service nova] Acquiring lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1f9ed0e5-f25e-4689-8333-1c983950cf2a req-c589781b-9b51-48cc-886b-ee9cd08d7db9 service nova] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1f9ed0e5-f25e-4689-8333-1c983950cf2a req-c589781b-9b51-48cc-886b-ee9cd08d7db9 service nova] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-1f9ed0e5-f25e-4689-8333-1c983950cf2a req-c589781b-9b51-48cc-886b-ee9cd08d7db9 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] No waiting events found dispatching network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:37:46 user nova-compute[75006]: WARNING nova.compute.manager [req-1f9ed0e5-f25e-4689-8333-1c983950cf2a req-c589781b-9b51-48cc-886b-ee9cd08d7db9 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received unexpected event network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 for instance with vm_state active and task_state None.
Nov 27 03:37:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6c7020a9-9fc0-4251-97e1-43297b81d574 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.448s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:37:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:37:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:37:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:37:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:37:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:37:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:37:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:37:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:37:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:00 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:38:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:38:03 user nova-compute[75006]: INFO nova.compute.manager [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Terminating instance
Nov 27 03:38:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-2f04a726-f7fd-4ceb-a3a9-bd70ab07ed48 req-60de69a0-2f4e-467e-9e47-e1c9e75c7845 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-unplugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2f04a726-f7fd-4ceb-a3a9-bd70ab07ed48 req-60de69a0-2f4e-467e-9e47-e1c9e75c7845 service nova] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2f04a726-f7fd-4ceb-a3a9-bd70ab07ed48 req-60de69a0-2f4e-467e-9e47-e1c9e75c7845 service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2f04a726-f7fd-4ceb-a3a9-bd70ab07ed48 req-60de69a0-2f4e-467e-9e47-e1c9e75c7845 service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-2f04a726-f7fd-4ceb-a3a9-bd70ab07ed48 req-60de69a0-2f4e-467e-9e47-e1c9e75c7845 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] No waiting events found dispatching network-vif-unplugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-2f04a726-f7fd-4ceb-a3a9-bd70ab07ed48 req-60de69a0-2f4e-467e-9e47-e1c9e75c7845 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-unplugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:38:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Instance destroyed successfully.
Nov 27 03:38:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:38:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7907MB free_disk=24.30013656616211GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.objects.instance [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'resources' on Instance uuid 5449b27f-2795-4ab6-a965-bdbbe9a9a59f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:32:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1685619028',display_name='tempest-ServerActionsTestOtherA-server-477263237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1685619028',id=37,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJFag2C77Tr4nhzxnc0tm5TpQOuqVamXe4nj4+Gk0KLzruErQ1k55s6Q8TO/stZcCT/wG7GOz0KVNgIVylEg5hU4pI8NSFtZskqPXMaykMNZszlWg7dAkBUiuxwzVsSCQ==',key_name='tempest-keypair-1724189151',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:34:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-zh8vdx7j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=5449b27f-2795-4ab6-a965-bdbbe9a9a59f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "address": "fa:16:3e:e6:23:80", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cc2684b-5d", "ovs_interfaceid": "5cc2684b-5d2c-4b80-8516-3838a2b54771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG os_vif [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cc2684b-5d, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e239be5-8772-4a5c-9d6b-aebca367599b) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:04 user nova-compute[75006]: INFO os_vif [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:23:80,bridge_name='br-int',has_traffic_filtering=True,id=5cc2684b-5d2c-4b80-8516-3838a2b54771,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cc2684b-5d')
Nov 27 03:38:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Deleting instance files /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f_del
Nov 27 03:38:04 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Deletion of /opt/stack/data/nova/instances/5449b27f-2795-4ab6-a965-bdbbe9a9a59f_del complete
Nov 27 03:38:04 user nova-compute[75006]: INFO nova.compute.manager [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 27 03:38:04 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cb58f809-30cb-487b-b608-f2c7973d2225 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6ae5f39a-0c6d-4538-b358-1eb6c753f442 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:38:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-959df65b-2b37-4369-b36b-a384579c963a req-edd4e6d0-8722-4c54-b871-402e88459f2b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-959df65b-2b37-4369-b36b-a384579c963a req-edd4e6d0-8722-4c54-b871-402e88459f2b service nova] Acquiring lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-959df65b-2b37-4369-b36b-a384579c963a req-edd4e6d0-8722-4c54-b871-402e88459f2b service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-959df65b-2b37-4369-b36b-a384579c963a req-edd4e6d0-8722-4c54-b871-402e88459f2b service nova] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-959df65b-2b37-4369-b36b-a384579c963a req-edd4e6d0-8722-4c54-b871-402e88459f2b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] No waiting events found dispatching network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:38:05 user nova-compute[75006]: WARNING nova.compute.manager [req-959df65b-2b37-4369-b36b-a384579c963a req-edd4e6d0-8722-4c54-b871-402e88459f2b service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received unexpected event network-vif-plugged-5cc2684b-5d2c-4b80-8516-3838a2b54771 for instance with vm_state active and task_state deleting.
Nov 27 03:38:05 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:38:05 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Took 1.12 seconds to deallocate network for instance.
Nov 27 03:38:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-7ef69cfa-80e5-4f95-a9cd-4d664810c141 req-4dc13bb7-df78-412c-bf64-8e83fdae56e8 service nova] [instance: 5449b27f-2795-4ab6-a965-bdbbe9a9a59f] Received event network-vif-deleted-5cc2684b-5d2c-4b80-8516-3838a2b54771 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:06 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Deleted allocations for instance 5449b27f-2795-4ab6-a965-bdbbe9a9a59f
Nov 27 03:38:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1cfef24e-3663-4cc3-8421-08746b09e497 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "5449b27f-2795-4ab6-a965-bdbbe9a9a59f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "cb58f809-30cb-487b-b608-f2c7973d2225" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:14 user nova-compute[75006]: INFO nova.compute.manager [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Terminating instance
Nov 27 03:38:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-6466eeb5-25fc-434e-a7f7-8a7b7018a9b6 req-c629e75f-1301-43e5-89f5-c7a3b1e5ad26 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-unplugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6466eeb5-25fc-434e-a7f7-8a7b7018a9b6 req-c629e75f-1301-43e5-89f5-c7a3b1e5ad26 service nova] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6466eeb5-25fc-434e-a7f7-8a7b7018a9b6 req-c629e75f-1301-43e5-89f5-c7a3b1e5ad26 service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6466eeb5-25fc-434e-a7f7-8a7b7018a9b6 req-c629e75f-1301-43e5-89f5-c7a3b1e5ad26 service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-6466eeb5-25fc-434e-a7f7-8a7b7018a9b6 req-c629e75f-1301-43e5-89f5-c7a3b1e5ad26 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] No waiting events found dispatching network-vif-unplugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-6466eeb5-25fc-434e-a7f7-8a7b7018a9b6 req-c629e75f-1301-43e5-89f5-c7a3b1e5ad26 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-unplugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:15 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Instance destroyed successfully.
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.objects.instance [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'resources' on Instance uuid cb58f809-30cb-487b-b608-f2c7973d2225 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-25001566',display_name='tempest-ServerRescueNegativeTestJSON-server-25001566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-25001566',id=19,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:24:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-grd0zaz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:24:05Z,user_data=None,user_id='797a8975406044ddabaad6e23950a71b',uuid=cb58f809-30cb-487b-b608-f2c7973d2225,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "address": "fa:16:3e:0c:8a:a9", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fa4288a-6c", "ovs_interfaceid": "6fa4288a-6cba-4a47-b71c-0f07522e84e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:8a:a9,bridge_name='br-int',has_traffic_filtering=True,id=6fa4288a-6cba-4a47-b71c-0f07522e84e8,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa4288a-6c') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG os_vif [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:8a:a9,bridge_name='br-int',has_traffic_filtering=True,id=6fa4288a-6cba-4a47-b71c-0f07522e84e8,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa4288a-6c') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fa4288a-6c, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=345b05de-3621-432f-9081-6ad83cfc9cfc) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:15 user nova-compute[75006]: INFO os_vif [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:8a:a9,bridge_name='br-int',has_traffic_filtering=True,id=6fa4288a-6cba-4a47-b71c-0f07522e84e8,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fa4288a-6c')
Nov 27 03:38:15 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Deleting instance files /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225_del
Nov 27 03:38:15 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Deletion of /opt/stack/data/nova/instances/cb58f809-30cb-487b-b608-f2c7973d2225_del complete
Nov 27 03:38:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:15 user nova-compute[75006]: INFO nova.compute.manager [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 27 03:38:15 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:38:15 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Took 0.53 seconds to deallocate network for instance.
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-c038c863-6f7f-4c33-87c6-b75f63688782 req-91c85137-03a6-4a39-a140-6fb2037be914 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-deleted-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:15 user nova-compute[75006]: INFO nova.compute.manager [req-c038c863-6f7f-4c33-87c6-b75f63688782 req-91c85137-03a6-4a39-a140-6fb2037be914 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Neutron deleted interface 6fa4288a-6cba-4a47-b71c-0f07522e84e8; detaching it from the instance and deleting it from the info cache
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.network.neutron [req-c038c863-6f7f-4c33-87c6-b75f63688782 req-91c85137-03a6-4a39-a140-6fb2037be914 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-c038c863-6f7f-4c33-87c6-b75f63688782 req-91c85137-03a6-4a39-a140-6fb2037be914 service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Detach interface failed, port_id=6fa4288a-6cba-4a47-b71c-0f07522e84e8, reason: Instance cb58f809-30cb-487b-b608-f2c7973d2225 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:16 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:38:16 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:38:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:16 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Deleted allocations for instance cb58f809-30cb-487b-b608-f2c7973d2225
Nov 27 03:38:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef72e042-2041-4dba-9a22-cde130c3c353 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "cb58f809-30cb-487b-b608-f2c7973d2225" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-49b0ce1d-34eb-4532-bd98-f7b75f29d85e req-d243be28-c9fc-4abd-af26-fbe23c29837d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-49b0ce1d-34eb-4532-bd98-f7b75f29d85e req-d243be28-c9fc-4abd-af26-fbe23c29837d service nova] Acquiring lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-49b0ce1d-34eb-4532-bd98-f7b75f29d85e req-d243be28-c9fc-4abd-af26-fbe23c29837d service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-49b0ce1d-34eb-4532-bd98-f7b75f29d85e req-d243be28-c9fc-4abd-af26-fbe23c29837d service nova] Lock "cb58f809-30cb-487b-b608-f2c7973d2225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-49b0ce1d-34eb-4532-bd98-f7b75f29d85e req-d243be28-c9fc-4abd-af26-fbe23c29837d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] No waiting events found dispatching network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:38:16 user nova-compute[75006]: WARNING nova.compute.manager [req-49b0ce1d-34eb-4532-bd98-f7b75f29d85e req-d243be28-c9fc-4abd-af26-fbe23c29837d service nova] [instance: cb58f809-30cb-487b-b608-f2c7973d2225] Received unexpected event network-vif-plugged-6fa4288a-6cba-4a47-b71c-0f07522e84e8 for instance with vm_state deleted and task_state None.
Nov 27 03:38:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:30 user nova-compute[75006]: INFO nova.compute.manager [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Rescuing
Nov 27 03:38:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquired lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG nova.network.neutron [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG nova.network.neutron [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Updating instance_info_cache with network_info: [{"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Releasing lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-38026c04-1a23-4163-a66e-d260661187d1 req-a4e09d96-418b-49e9-82ba-004207bfda12 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-38026c04-1a23-4163-a66e-d260661187d1 req-a4e09d96-418b-49e9-82ba-004207bfda12 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-38026c04-1a23-4163-a66e-d260661187d1 req-a4e09d96-418b-49e9-82ba-004207bfda12 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-38026c04-1a23-4163-a66e-d260661187d1 req-a4e09d96-418b-49e9-82ba-004207bfda12 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-38026c04-1a23-4163-a66e-d260661187d1 req-a4e09d96-418b-49e9-82ba-004207bfda12 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:38:30 user nova-compute[75006]: WARNING nova.compute.manager [req-38026c04-1a23-4163-a66e-d260661187d1 req-a4e09d96-418b-49e9-82ba-004207bfda12 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state active and task_state rescuing.
Nov 27 03:38:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance destroyed successfully.
Nov 27 03:38:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Attempting a stable device rescue
Nov 27 03:38:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75006) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 03:38:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance directory exists: not creating {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 03:38:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Creating image(s)
Nov 27 03:38:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "/opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "/opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:31 user nova-compute[75006]: DEBUG nova.objects.instance [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "f512782b6438a64b16939eb5c48fee85d295ac60" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "f512782b6438a64b16939eb5c48fee85d295ac60" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-c5d48ef3-b23f-4f30-8199-2b419b6fdbdd req-67bb561f-f3f6-4867-a81c-0e8bd2ae4c04 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5d48ef3-b23f-4f30-8199-2b419b6fdbdd req-67bb561f-f3f6-4867-a81c-0e8bd2ae4c04 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5d48ef3-b23f-4f30-8199-2b419b6fdbdd req-67bb561f-f3f6-4867-a81c-0e8bd2ae4c04 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c5d48ef3-b23f-4f30-8199-2b419b6fdbdd req-67bb561f-f3f6-4867-a81c-0e8bd2ae4c04 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-c5d48ef3-b23f-4f30-8199-2b419b6fdbdd req-67bb561f-f3f6-4867-a81c-0e8bd2ae4c04 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:38:32 user nova-compute[75006]: WARNING nova.compute.manager [req-c5d48ef3-b23f-4f30-8199-2b419b6fdbdd req-67bb561f-f3f6-4867-a81c-0e8bd2ae4c04 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state active and task_state rescuing.
Nov 27 03:38:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG nova.virt.images [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] 0128a6a4-0496-47c4-9500-49a3e8d9346b was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:38:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60.part /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60.part /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60.converted" returned: 0 in 0.250s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "f512782b6438a64b16939eb5c48fee85d295ac60" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.917s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "f512782b6438a64b16939eb5c48fee85d295ac60" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "f512782b6438a64b16939eb5c48fee85d295ac60" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60 --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60 --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60,backing_fmt=raw /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60,backing_fmt=raw /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue" returned: 0 in 0.148s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "f512782b6438a64b16939eb5c48fee85d295ac60" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'migration_context' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.objects.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<6ae5f39a-0c6d-4538-b358-1eb6c753f442> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Start _get_guest_xml network_info=[{"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "vif_mac": "fa:16:3e:a2:0c:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0128a6a4-0496-47c4-9500-49a3e8d9346b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '0bd11e58-d538-49c3-b237-ee60eb48be1a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtamYupB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6ae5f39a-0c6d-4538-b358-1eb6c753f442', 'attached_at': '', 'detached_at': '', 'volume_id': '31cb72e8-aee3-4768-abf3-2c010176a4ba', 'serial': '31cb72e8-aee3-4768-abf3-2c010176a4ba'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'resources' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.objects.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<6ae5f39a-0c6d-4538-b358-1eb6c753f442> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.objects.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<6ae5f39a-0c6d-4538-b358-1eb6c753f442> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:33 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:38:33 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.objects.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<6ae5f39a-0c6d-4538-b358-1eb6c753f442> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtamYupB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:38:33 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:38:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:38:33 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:38:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:38:33 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0b716-dfb3-4adb-b03b-4026fe965596]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DtamYupB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 03:38:33 user nova-compute[75006]: node.name = iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba
Nov 27 03:38:33 user nova-compute[75006]: node.tpgt = -1
Nov 27 03:38:33 user nova-compute[75006]: node.startup = automatic
Nov 27 03:38:33 user nova-compute[75006]: node.leading_login = No
Nov 27 03:38:33 user nova-compute[75006]: iface.iscsi_ifacename = default
Nov 27 03:38:33 user nova-compute[75006]: iface.net_ifacename = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.ipaddress = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.prefix_len = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.hwaddress = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.transport_name = tcp
Nov 27 03:38:33 user nova-compute[75006]: iface.initiatorname = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.state = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.vlan_id = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.vlan_priority = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.vlan_state = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.iface_num = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.mtu = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.port = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.bootproto = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.subnet_mask = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.gateway = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.dhcp_alt_client_id = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.dhcp_dns = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.dhcp_learn_iqn = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.dhcp_vendor_id_state = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.dhcp_vendor_id = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.dhcp_slp_da = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.fragmentation = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.gratuitous_arp = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.incoming_forwarding = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.tos_state = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.tos = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.ttl = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.delayed_ack = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.tcp_nagle = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.tcp_wsf_state = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.tcp_wsf = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.tcp_timer_scale = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.tcp_timestamp = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.redirect = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.def_task_mgmt_timeout = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.header_digest = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.data_digest = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.immediate_data = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.initial_r2t = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.data_seq_inorder = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.data_pdu_inorder = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.erl = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.max_receive_data_len = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.first_burst_len = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.max_outstanding_r2t = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.max_burst_len = 0
Nov 27 03:38:33 user nova-compute[75006]: iface.chap_auth = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.bidi_chap = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.strict_login_compliance = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.discovery_auth = <empty>
Nov 27 03:38:33 user nova-compute[75006]: iface.discovery_logout = <empty>
Nov 27 03:38:33 user nova-compute[75006]: node.discovery_address = <empty>
Nov 27 03:38:33 user nova-compute[75006]: node.discovery_port = 0
Nov 27 03:38:33 user nova-compute[75006]: node.discovery_type = static
Nov 27 03:38:33 user nova-compute[75006]: node.session.initial_cmdsn = 0
Nov 27 03:38:33 user nova-compute[75006]: node.session.initial_login_retry_max = 8
Nov 27 03:38:33 user nova-compute[75006]: node.session.xmit_thread_priority = -20
Nov 27 03:38:33 user nova-compute[75006]: node.session.cmds_max = 128
Nov 27 03:38:33 user nova-compute[75006]: node.session.queue_depth = 32
Nov 27 03:38:33 user nova-compute[75006]: node.session.nr_sessions = 1
Nov 27 03:38:33 user nova-compute[75006]: node.session.auth.authmethod = CHAP
Nov 27 03:38:33 user nova-compute[75006]: node.session.auth.username = DtamYupB
Nov 27 03:38:33 user nova-compute[75006]: node.session.auth.password = ***
Nov 27 03:38:33 user nova-compute[75006]: node.session.auth.username_in = <empty>
Nov 27 03:38:33 user nova-compute[75006]: node.session.auth.password_in = <empty>
Nov 27 03:38:33 user nova-compute[75006]: node.session.auth.chap_algs = MD5
Nov 27 03:38:33 user nova-compute[75006]: node.session.timeo.replacement_timeout = 120
Nov 27 03:38:33 user nova-compute[75006]: node.session.err_timeo.abort_timeout = 15
Nov 27 03:38:33 user nova-compute[75006]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 03:38:33 user nova-compute[75006]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 03:38:33 user nova-compute[75006]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.FastAbort = Yes
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.InitialR2T = No
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.ImmediateData = Yes
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.MaxConnections = 1
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 03:38:33 user nova-compute[75006]: node.session.iscsi.ERL = 0
Nov 27 03:38:33 user nova-compute[75006]: node.session.scan = manual
Nov 27 03:38:33 user nova-compute[75006]: node.session.reopen_max = 0
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].address = 172.16.0.220
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].port = 3260
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].startup = manual
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].tcp.window_size = 524288
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].tcp.type_of_service = 0
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].timeo.logout_timeout = 15
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].timeo.login_timeout = 15
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].timeo.auth_timeout = 45
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].iscsi.DataDigest = None
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].iscsi.IFMarker = No
Nov 27 03:38:33 user nova-compute[75006]: node.conn[0].iscsi.OFMarker = No
Nov 27 03:38:33 user nova-compute[75006]: # END RECORD
Nov 27 03:38:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e01a6b-7585-43e9-8782-031763ff1a9b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[389a052a-8b50-4ad2-89a7-b5fafe1ec094]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:38:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtamYupB {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtamYupB" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9691f5a3-aec1-4c19-a351-f3f94970e234]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DtamYupB'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1db94c-d068-4368-8939-a45f9776fbee]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4041cc6-8f33-4b6f-8fe8-e2b40c480d96]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:38:34 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:38:34 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:38:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:38:34 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:38:34 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:38:34 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] HCTL ('33', '0', '0', 0) found on session 45 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5f0a67-450e-417d-8ba1-84adde6d1dd7]: (4, ('0 0 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Searching for a device in session 45 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtamYupB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.177s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] <== connect_volume: return (178ms) {'type': 'block', 'scsi_wwn': '23238316239613961', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238316239613961', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1452538442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1452538442',id=42,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:36:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-kdywof2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:36:57Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=6ae5f39a-0c6d-4538-b358-1eb6c753f442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "vif_mac": "fa:16:3e:a2:0c:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "vif_mac": "fa:16:3e:a2:0c:56"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:0c:56,bridge_name='br-int',has_traffic_filtering=True,id=5c7595e4-d17a-4894-be14-84875dd85457,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7595e4-d1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.objects.instance [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.objects.base [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Object Instance<6ae5f39a-0c6d-4538-b358-1eb6c753f442> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:38:34 user nova-compute[75006]:   <uuid>6ae5f39a-0c6d-4538-b358-1eb6c753f442</uuid>
Nov 27 03:38:34 user nova-compute[75006]:   <name>instance-0000002a</name>
Nov 27 03:38:34 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:38:34 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:38:34 user nova-compute[75006]:   <metadata>
Nov 27 03:38:34 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:38:34 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:38:34 user nova-compute[75006]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1452538442</nova:name>
Nov 27 03:38:34 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:38:33</nova:creationTime>
Nov 27 03:38:34 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:38:34 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:38:34 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:38:34 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:38:34 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:38:34 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:38:34 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:38:34 user nova-compute[75006]:       <nova:owner>
Nov 27 03:38:34 user nova-compute[75006]:         <nova:user uuid="7bdc7ee98a95432d96679fc697b7d61d">tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member</nova:user>
Nov 27 03:38:34 user nova-compute[75006]:         <nova:project uuid="03bbdcea84574886bbea67eefc84dca0">tempest-ServerBootFromVolumeStableRescueTest-2135085811</nova:project>
Nov 27 03:38:34 user nova-compute[75006]:       </nova:owner>
Nov 27 03:38:34 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:38:34 user nova-compute[75006]:       <nova:ports>
Nov 27 03:38:34 user nova-compute[75006]:         <nova:port uuid="5c7595e4-d17a-4894-be14-84875dd85457">
Nov 27 03:38:34 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 03:38:34 user nova-compute[75006]:         </nova:port>
Nov 27 03:38:34 user nova-compute[75006]:       </nova:ports>
Nov 27 03:38:34 user nova-compute[75006]:     </nova:instance>
Nov 27 03:38:34 user nova-compute[75006]:   </metadata>
Nov 27 03:38:34 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:38:34 user nova-compute[75006]:     <system>
Nov 27 03:38:34 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:38:34 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:38:34 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:38:34 user nova-compute[75006]:       <entry name="serial">6ae5f39a-0c6d-4538-b358-1eb6c753f442</entry>
Nov 27 03:38:34 user nova-compute[75006]:       <entry name="uuid">6ae5f39a-0c6d-4538-b358-1eb6c753f442</entry>
Nov 27 03:38:34 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:38:34 user nova-compute[75006]:     </system>
Nov 27 03:38:34 user nova-compute[75006]:   </sysinfo>
Nov 27 03:38:34 user nova-compute[75006]:   <os>
Nov 27 03:38:34 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:38:34 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:38:34 user nova-compute[75006]:   </os>
Nov 27 03:38:34 user nova-compute[75006]:   <features>
Nov 27 03:38:34 user nova-compute[75006]:     <acpi/>
Nov 27 03:38:34 user nova-compute[75006]:     <apic/>
Nov 27 03:38:34 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:38:34 user nova-compute[75006]:   </features>
Nov 27 03:38:34 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:38:34 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:38:34 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:38:34 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:38:34 user nova-compute[75006]:   </clock>
Nov 27 03:38:34 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:38:34 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:38:34 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:38:34 user nova-compute[75006]:   </cpu>
Nov 27 03:38:34 user nova-compute[75006]:   <devices>
Nov 27 03:38:34 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:38:34 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:38:34 user nova-compute[75006]:       <source dev="/dev/sdb"/>
Nov 27 03:38:34 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:38:34 user nova-compute[75006]:       <serial>31cb72e8-aee3-4768-abf3-2c010176a4ba</serial>
Nov 27 03:38:34 user nova-compute[75006]:     </disk>
Nov 27 03:38:34 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:38:34 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:38:34 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue"/>
Nov 27 03:38:34 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:38:34 user nova-compute[75006]:       <boot order="1"/>
Nov 27 03:38:34 user nova-compute[75006]:     </disk>
Nov 27 03:38:34 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:38:34 user nova-compute[75006]:       <mac address="fa:16:3e:a2:0c:56"/>
Nov 27 03:38:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:38:34 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:38:34 user nova-compute[75006]:       <target dev="tap5c7595e4-d1"/>
Nov 27 03:38:34 user nova-compute[75006]:     </interface>
Nov 27 03:38:34 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:38:34 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/console.log" append="off"/>
Nov 27 03:38:34 user nova-compute[75006]:     </serial>
Nov 27 03:38:34 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:38:34 user nova-compute[75006]:     <video>
Nov 27 03:38:34 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:38:34 user nova-compute[75006]:     </video>
Nov 27 03:38:34 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:38:34 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:38:34 user nova-compute[75006]:     </rng>
Nov 27 03:38:34 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:38:34 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:38:34 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:38:34 user nova-compute[75006]:     </memballoon>
Nov 27 03:38:34 user nova-compute[75006]:   </devices>
Nov 27 03:38:34 user nova-compute[75006]: </domain>
Nov 27 03:38:34 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:38:34 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance destroyed successfully.
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:38:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] No VIF found with MAC fa:16:3e:a2:0c:56, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-6b77be0a-9427-4a64-b980-0403c9b61d11 req-b3e8b6b5-20e5-4b24-b33e-672352371632 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6b77be0a-9427-4a64-b980-0403c9b61d11 req-b3e8b6b5-20e5-4b24-b33e-672352371632 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6b77be0a-9427-4a64-b980-0403c9b61d11 req-b3e8b6b5-20e5-4b24-b33e-672352371632 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6b77be0a-9427-4a64-b980-0403c9b61d11 req-b3e8b6b5-20e5-4b24-b33e-672352371632 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-6b77be0a-9427-4a64-b980-0403c9b61d11 req-b3e8b6b5-20e5-4b24-b33e-672352371632 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:38:35 user nova-compute[75006]: WARNING nova.compute.manager [req-6b77be0a-9427-4a64-b980-0403c9b61d11 req-b3e8b6b5-20e5-4b24-b33e-672352371632 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state active and task_state rescuing.
Nov 27 03:38:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-c81e1a32-ee54-48b2-981e-84535fdacb79 req-8daa481c-a370-45d3-ad07-4f37423cbf85 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c81e1a32-ee54-48b2-981e-84535fdacb79 req-8daa481c-a370-45d3-ad07-4f37423cbf85 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c81e1a32-ee54-48b2-981e-84535fdacb79 req-8daa481c-a370-45d3-ad07-4f37423cbf85 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c81e1a32-ee54-48b2-981e-84535fdacb79 req-8daa481c-a370-45d3-ad07-4f37423cbf85 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:37 user nova-compute[75006]: DEBUG nova.compute.manager [req-c81e1a32-ee54-48b2-981e-84535fdacb79 req-8daa481c-a370-45d3-ad07-4f37423cbf85 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:38:37 user nova-compute[75006]: WARNING nova.compute.manager [req-c81e1a32-ee54-48b2-981e-84535fdacb79 req-8daa481c-a370-45d3-ad07-4f37423cbf85 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state active and task_state rescuing.
Nov 27 03:38:37 user nova-compute[75006]: DEBUG nova.compute.manager [None req-627fa316-44af-4ec1-aa79-fa5cf60f96f2 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:38:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:38:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:38:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:38:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:51 user nova-compute[75006]: INFO nova.compute.manager [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Unshelving
Nov 27 03:38:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:51 user nova-compute[75006]: DEBUG nova.objects.instance [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'pci_requests' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:51 user nova-compute[75006]: DEBUG nova.objects.instance [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'numa_topology' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:51 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:38:51 user nova-compute[75006]: INFO nova.compute.claims [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Claim successful on node user
Nov 27 03:38:52 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:38:52 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:38:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:52 user nova-compute[75006]: INFO nova.network.neutron [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating port eaa6a3ce-8452-4582-ad29-df86bdf610aa with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 03:38:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:38:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquired lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:38:52 user nova-compute[75006]: DEBUG nova.network.neutron [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:38:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-b05cdd78-1b06-4804-9445-bd347c162419 req-022d6da6-a7e4-4500-9e62-428820ebbdb1 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-changed-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:38:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-b05cdd78-1b06-4804-9445-bd347c162419 req-022d6da6-a7e4-4500-9e62-428820ebbdb1 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Refreshing instance network info cache due to event network-changed-eaa6a3ce-8452-4582-ad29-df86bdf610aa. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:38:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b05cdd78-1b06-4804-9445-bd347c162419 req-022d6da6-a7e4-4500-9e62-428820ebbdb1 service nova] Acquiring lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG nova.network.neutron [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating instance_info_cache with network_info: [{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Releasing lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:38:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Creating image(s)
Nov 27 03:38:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG nova.objects.instance [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'trusted_certs' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b05cdd78-1b06-4804-9445-bd347c162419 req-022d6da6-a7e4-4500-9e62-428820ebbdb1 service nova] Acquired lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG nova.network.neutron [req-b05cdd78-1b06-4804-9445-bd347c162419 req-022d6da6-a7e4-4500-9e62-428820ebbdb1 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Refreshing network info cache for port eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG nova.objects.base [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<326427b4-70bc-49e0-ae50-b8daf2c3421a> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "45175aaada3c093c7cdd34674c63b69a3546e88f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "45175aaada3c093c7cdd34674c63b69a3546e88f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG nova.virt.images [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1 was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f.part /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG nova.network.neutron [req-b05cdd78-1b06-4804-9445-bd347c162419 req-022d6da6-a7e4-4500-9e62-428820ebbdb1 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updated VIF entry in instance network info cache for port eaa6a3ce-8452-4582-ad29-df86bdf610aa. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG nova.network.neutron [req-b05cdd78-1b06-4804-9445-bd347c162419 req-022d6da6-a7e4-4500-9e62-428820ebbdb1 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating instance_info_cache with network_info: [{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:38:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b05cdd78-1b06-4804-9445-bd347c162419 req-022d6da6-a7e4-4500-9e62-428820ebbdb1 service nova] Releasing lock "refresh_cache-326427b4-70bc-49e0-ae50-b8daf2c3421a" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f.part /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f.converted" returned: 0 in 0.602s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "45175aaada3c093c7cdd34674c63b69a3546e88f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.192s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "45175aaada3c093c7cdd34674c63b69a3546e88f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "45175aaada3c093c7cdd34674c63b69a3546e88f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f,backing_fmt=raw /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f,backing_fmt=raw /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk 1073741824" returned: 0 in 0.051s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "45175aaada3c093c7cdd34674c63b69a3546e88f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:56 user nova-compute[75006]: DEBUG nova.objects.instance [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'migration_context' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:56 user nova-compute[75006]: DEBUG nova.objects.base [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<326427b4-70bc-49e0-ae50-b8daf2c3421a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Rebasing disk image.
Nov 27 03:38:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe -F raw /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:38:57 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe -F raw /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk" returned: 0 in 2.036s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Ensure instance console log exists: /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Start _get_guest_xml network_info=[{"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0da18ce1d5aed9f614e21bebfc8c9b49',container_format='bare',created_at=2023-11-27T03:36:59Z,direct_url=<?>,disk_format='qcow2',id=a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1895041011-shelved',owner='8891478cee7d4a89bd27cd45a9732ac9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T03:37:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:38:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:38:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0da18ce1d5aed9f614e21bebfc8c9b49',container_format='bare',created_at=2023-11-27T03:36:59Z,direct_url=<?>,disk_format='qcow2',id=a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1895041011-shelved',owner='8891478cee7d4a89bd27cd45a9732ac9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T03:37:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'vcpu_model' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.objects.base [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<326427b4-70bc-49e0-ae50-b8daf2c3421a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895041011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895041011',id=41,image_ref='a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1897998770',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:35:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-umhbpt7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member',shelved_at='2023-11-27T03:37:03.989301',shelved_host='user',shelved_image_id='a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=326427b4-70bc-49e0-ae50-b8daf2c3421a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'pci_devices' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.objects.base [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Object Instance<326427b4-70bc-49e0-ae50-b8daf2c3421a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:38:58 user nova-compute[75006]:   <uuid>326427b4-70bc-49e0-ae50-b8daf2c3421a</uuid>
Nov 27 03:38:58 user nova-compute[75006]:   <name>instance-00000029</name>
Nov 27 03:38:58 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:38:58 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:38:58 user nova-compute[75006]:   <metadata>
Nov 27 03:38:58 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:38:58 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:38:58 user nova-compute[75006]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1895041011</nova:name>
Nov 27 03:38:58 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:38:58</nova:creationTime>
Nov 27 03:38:58 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:38:58 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:38:58 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:38:58 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:38:58 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:38:58 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:38:58 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:38:58 user nova-compute[75006]:       <nova:owner>
Nov 27 03:38:58 user nova-compute[75006]:         <nova:user uuid="6153e4e893d74cdcae25fae6db9fc589">tempest-AttachVolumeShelveTestJSON-392586266-project-member</nova:user>
Nov 27 03:38:58 user nova-compute[75006]:         <nova:project uuid="8891478cee7d4a89bd27cd45a9732ac9">tempest-AttachVolumeShelveTestJSON-392586266</nova:project>
Nov 27 03:38:58 user nova-compute[75006]:       </nova:owner>
Nov 27 03:38:58 user nova-compute[75006]:       <nova:root type="image" uuid="a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1"/>
Nov 27 03:38:58 user nova-compute[75006]:       <nova:ports>
Nov 27 03:38:58 user nova-compute[75006]:         <nova:port uuid="eaa6a3ce-8452-4582-ad29-df86bdf610aa">
Nov 27 03:38:58 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 27 03:38:58 user nova-compute[75006]:         </nova:port>
Nov 27 03:38:58 user nova-compute[75006]:       </nova:ports>
Nov 27 03:38:58 user nova-compute[75006]:     </nova:instance>
Nov 27 03:38:58 user nova-compute[75006]:   </metadata>
Nov 27 03:38:58 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:38:58 user nova-compute[75006]:     <system>
Nov 27 03:38:58 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:38:58 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:38:58 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:38:58 user nova-compute[75006]:       <entry name="serial">326427b4-70bc-49e0-ae50-b8daf2c3421a</entry>
Nov 27 03:38:58 user nova-compute[75006]:       <entry name="uuid">326427b4-70bc-49e0-ae50-b8daf2c3421a</entry>
Nov 27 03:38:58 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:38:58 user nova-compute[75006]:     </system>
Nov 27 03:38:58 user nova-compute[75006]:   </sysinfo>
Nov 27 03:38:58 user nova-compute[75006]:   <os>
Nov 27 03:38:58 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:38:58 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:38:58 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:38:58 user nova-compute[75006]:   </os>
Nov 27 03:38:58 user nova-compute[75006]:   <features>
Nov 27 03:38:58 user nova-compute[75006]:     <acpi/>
Nov 27 03:38:58 user nova-compute[75006]:     <apic/>
Nov 27 03:38:58 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:38:58 user nova-compute[75006]:   </features>
Nov 27 03:38:58 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:38:58 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:38:58 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:38:58 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:38:58 user nova-compute[75006]:   </clock>
Nov 27 03:38:58 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:38:58 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:38:58 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:38:58 user nova-compute[75006]:   </cpu>
Nov 27 03:38:58 user nova-compute[75006]:   <devices>
Nov 27 03:38:58 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:38:58 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:38:58 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk"/>
Nov 27 03:38:58 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:38:58 user nova-compute[75006]:     </disk>
Nov 27 03:38:58 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:38:58 user nova-compute[75006]:       <mac address="fa:16:3e:0f:92:25"/>
Nov 27 03:38:58 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:38:58 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:38:58 user nova-compute[75006]:       <target dev="tapeaa6a3ce-84"/>
Nov 27 03:38:58 user nova-compute[75006]:     </interface>
Nov 27 03:38:58 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:38:58 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/console.log" append="off"/>
Nov 27 03:38:58 user nova-compute[75006]:     </serial>
Nov 27 03:38:58 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:38:58 user nova-compute[75006]:     <video>
Nov 27 03:38:58 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:38:58 user nova-compute[75006]:     </video>
Nov 27 03:38:58 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:38:58 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:38:58 user nova-compute[75006]:     </rng>
Nov 27 03:38:58 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:38:58 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:38:58 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:38:58 user nova-compute[75006]:     </memballoon>
Nov 27 03:38:58 user nova-compute[75006]:   </devices>
Nov 27 03:38:58 user nova-compute[75006]: </domain>
Nov 27 03:38:58 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895041011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895041011',id=41,image_ref='a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1897998770',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:35:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-umhbpt7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member',shelved_at='2023-11-27T03:37:03.989301',shelved_host='user',shelved_image_id='a6b4dd87-179a-4d7c-bef5-00d5bf6d35a1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=326427b4-70bc-49e0-ae50-b8daf2c3421a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG os_vif [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88328aa1-4bd1-5311-a935-fe7b6a7d2671', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaa6a3ce-84, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaa6a3ce-84, col_values=(('qos', UUID('7267144d-22f7-4f3c-b7c5-93ed8c106c0d')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaa6a3ce-84, col_values=(('external_ids', {'iface-id': 'eaa6a3ce-8452-4582-ad29-df86bdf610aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:92:25', 'vm-uuid': '326427b4-70bc-49e0-ae50-b8daf2c3421a'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:58 user nova-compute[75006]: INFO os_vif [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84')
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] No VIF found with MAC fa:16:3e:0f:92:25, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:38:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:38:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:38:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-812c9793-aa2c-4d78-a847-3a86d2d70c46 req-0c235fd6-f5ff-47f8-8482-e55f94c058a3 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-812c9793-aa2c-4d78-a847-3a86d2d70c46 req-0c235fd6-f5ff-47f8-8482-e55f94c058a3 service nova] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-812c9793-aa2c-4d78-a847-3a86d2d70c46 req-0c235fd6-f5ff-47f8-8482-e55f94c058a3 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-812c9793-aa2c-4d78-a847-3a86d2d70c46 req-0c235fd6-f5ff-47f8-8482-e55f94c058a3 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG nova.compute.manager [req-812c9793-aa2c-4d78-a847-3a86d2d70c46 req-0c235fd6-f5ff-47f8-8482-e55f94c058a3 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] No waiting events found dispatching network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:39:00 user nova-compute[75006]: WARNING nova.compute.manager [req-812c9793-aa2c-4d78-a847-3a86d2d70c46 req-0c235fd6-f5ff-47f8-8482-e55f94c058a3 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received unexpected event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 03:39:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:39:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:39:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance spawned successfully.
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-f7e5a1b6-80b9-41e1-b4b5-446c0bd5a3db req-dd7b6a3a-ffc8-4ac4-b37f-4c91cce99541 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f7e5a1b6-80b9-41e1-b4b5-446c0bd5a3db req-dd7b6a3a-ffc8-4ac4-b37f-4c91cce99541 service nova] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f7e5a1b6-80b9-41e1-b4b5-446c0bd5a3db req-dd7b6a3a-ffc8-4ac4-b37f-4c91cce99541 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f7e5a1b6-80b9-41e1-b4b5-446c0bd5a3db req-dd7b6a3a-ffc8-4ac4-b37f-4c91cce99541 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG nova.compute.manager [req-f7e5a1b6-80b9-41e1-b4b5-446c0bd5a3db req-dd7b6a3a-ffc8-4ac4-b37f-4c91cce99541 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] No waiting events found dispatching network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:39:02 user nova-compute[75006]: WARNING nova.compute.manager [req-f7e5a1b6-80b9-41e1-b4b5-446c0bd5a3db req-dd7b6a3a-ffc8-4ac4-b37f-4c91cce99541 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received unexpected event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 03:39:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-187ab8f5-acb0-4518-bd17-38c2efc17c99 tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.608s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:39:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8175MB free_disk=24.866676330566406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6ae5f39a-0c6d-4538-b358-1eb6c753f442 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 326427b4-70bc-49e0-ae50-b8daf2c3421a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:39:03 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:04 user nova-compute[75006]: INFO nova.compute.manager [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Terminating instance
Nov 27 03:39:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-778b7a9d-2b16-4042-ace4-e77b9c70e074 req-55b8eff8-1b4e-46d3-bff4-9e5329e58312 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-778b7a9d-2b16-4042-ace4-e77b9c70e074 req-55b8eff8-1b4e-46d3-bff4-9e5329e58312 service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-778b7a9d-2b16-4042-ace4-e77b9c70e074 req-55b8eff8-1b4e-46d3-bff4-9e5329e58312 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-778b7a9d-2b16-4042-ace4-e77b9c70e074 req-55b8eff8-1b4e-46d3-bff4-9e5329e58312 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-778b7a9d-2b16-4042-ace4-e77b9c70e074 req-55b8eff8-1b4e-46d3-bff4-9e5329e58312 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-778b7a9d-2b16-4042-ace4-e77b9c70e074 req-55b8eff8-1b4e-46d3-bff4-9e5329e58312 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-unplugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Instance destroyed successfully.
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.objects.instance [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lazy-loading 'resources' on Instance uuid 831e3e26-daed-4b73-9470-0383e2cf6e0f {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:22:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1753296171',display_name='tempest-ServerRescueNegativeTestJSON-server-1753296171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1753296171',id=18,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b2d179ed36d41038da75b63b1bde170',ramdisk_id='',reservation_id='r-05m618k5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-599355303',owner_user_name='tempest-ServerRescueNegativeTestJSON-599355303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:28:50Z,user_data=None,user_id='797a8975406044ddabaad6e23950a71b',uuid=831e3e26-daed-4b73-9470-0383e2cf6e0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converting VIF {"id": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "address": "fa:16:3e:09:88:83", "network": {"id": "b0f40b95-a3bb-442e-83be-fcc7606a0bc8", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-86927577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b2d179ed36d41038da75b63b1bde170", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ff1b53-23", "ovs_interfaceid": "12ff1b53-230e-4e26-87d3-d3e6820f3bfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:88:83,bridge_name='br-int',has_traffic_filtering=True,id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ff1b53-23') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG os_vif [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:88:83,bridge_name='br-int',has_traffic_filtering=True,id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ff1b53-23') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12ff1b53-23, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ad6cb94-cb2e-4ebf-a591-de17a8847661) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:39:05 user nova-compute[75006]: INFO os_vif [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:88:83,bridge_name='br-int',has_traffic_filtering=True,id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd,network=Network(b0f40b95-a3bb-442e-83be-fcc7606a0bc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ff1b53-23')
Nov 27 03:39:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Deleting instance files /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f_del
Nov 27 03:39:05 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Deletion of /opt/stack/data/nova/instances/831e3e26-daed-4b73-9470-0383e2cf6e0f_del complete
Nov 27 03:39:05 user nova-compute[75006]: INFO nova.compute.manager [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 27 03:39:05 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:39:05 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Took 0.40 seconds to deallocate network for instance.
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-eb9f718d-2757-4884-8d1d-c22028cc74eb req-9c98c1fc-721c-4ee0-9a38-24245e3605bd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-deleted-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:05 user nova-compute[75006]: INFO nova.compute.manager [req-eb9f718d-2757-4884-8d1d-c22028cc74eb req-9c98c1fc-721c-4ee0-9a38-24245e3605bd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Neutron deleted interface 12ff1b53-230e-4e26-87d3-d3e6820f3bfd; detaching it from the instance and deleting it from the info cache
Nov 27 03:39:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-eb9f718d-2757-4884-8d1d-c22028cc74eb req-9c98c1fc-721c-4ee0-9a38-24245e3605bd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-eb9f718d-2757-4884-8d1d-c22028cc74eb req-9c98c1fc-721c-4ee0-9a38-24245e3605bd service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Detach interface failed, port_id=12ff1b53-230e-4e26-87d3-d3e6820f3bfd, reason: Instance 831e3e26-daed-4b73-9470-0383e2cf6e0f could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updating instance_info_cache with network_info: [{"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:06 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Deleted allocations for instance 831e3e26-daed-4b73-9470-0383e2cf6e0f
Nov 27 03:39:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-7423faa1-3c41-4fff-8863-f3a651e30c34 tempest-ServerRescueNegativeTestJSON-599355303 tempest-ServerRescueNegativeTestJSON-599355303-project-member] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:07 user nova-compute[75006]: DEBUG nova.compute.manager [req-3b0f5283-48a1-454f-bc3b-71a70e738ca3 req-d900f9f9-b95c-4f3a-bf02-3a7310f21fd5 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3b0f5283-48a1-454f-bc3b-71a70e738ca3 req-d900f9f9-b95c-4f3a-bf02-3a7310f21fd5 service nova] Acquiring lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3b0f5283-48a1-454f-bc3b-71a70e738ca3 req-d900f9f9-b95c-4f3a-bf02-3a7310f21fd5 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3b0f5283-48a1-454f-bc3b-71a70e738ca3 req-d900f9f9-b95c-4f3a-bf02-3a7310f21fd5 service nova] Lock "831e3e26-daed-4b73-9470-0383e2cf6e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:07 user nova-compute[75006]: DEBUG nova.compute.manager [req-3b0f5283-48a1-454f-bc3b-71a70e738ca3 req-d900f9f9-b95c-4f3a-bf02-3a7310f21fd5 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] No waiting events found dispatching network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:39:07 user nova-compute[75006]: WARNING nova.compute.manager [req-3b0f5283-48a1-454f-bc3b-71a70e738ca3 req-d900f9f9-b95c-4f3a-bf02-3a7310f21fd5 service nova] [instance: 831e3e26-daed-4b73-9470-0383e2cf6e0f] Received unexpected event network-vif-plugged-12ff1b53-230e-4e26-87d3-d3e6820f3bfd for instance with vm_state deleted and task_state None.
Nov 27 03:39:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:39:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:39:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-cb6253cf-f3d5-4b8c-b6cd-81393e716a52 req-15b70aee-002c-47cf-9ff3-b6670300bfeb service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received event network-changed-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-cb6253cf-f3d5-4b8c-b6cd-81393e716a52 req-15b70aee-002c-47cf-9ff3-b6670300bfeb service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Refreshing instance network info cache due to event network-changed-007cf0a9-821e-4da0-99b6-6b4f7ced9c83. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cb6253cf-f3d5-4b8c-b6cd-81393e716a52 req-15b70aee-002c-47cf-9ff3-b6670300bfeb service nova] Acquiring lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cb6253cf-f3d5-4b8c-b6cd-81393e716a52 req-15b70aee-002c-47cf-9ff3-b6670300bfeb service nova] Acquired lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG nova.network.neutron [req-cb6253cf-f3d5-4b8c-b6cd-81393e716a52 req-15b70aee-002c-47cf-9ff3-b6670300bfeb service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Refreshing network info cache for port 007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG nova.network.neutron [req-cb6253cf-f3d5-4b8c-b6cd-81393e716a52 req-15b70aee-002c-47cf-9ff3-b6670300bfeb service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Updated VIF entry in instance network info cache for port 007cf0a9-821e-4da0-99b6-6b4f7ced9c83. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG nova.network.neutron [req-cb6253cf-f3d5-4b8c-b6cd-81393e716a52 req-15b70aee-002c-47cf-9ff3-b6670300bfeb service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Updating instance_info_cache with network_info: [{"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cb6253cf-f3d5-4b8c-b6cd-81393e716a52 req-15b70aee-002c-47cf-9ff3-b6670300bfeb service nova] Releasing lock "refresh_cache-84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:39:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "1184d774-d1f5-4e67-91ad-7931cfe7d077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:39:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:32 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:39:32 user nova-compute[75006]: INFO nova.compute.claims [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Claim successful on node user
Nov 27 03:39:32 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:39:32 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:39:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:39:32 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:39:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:39:32 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:39:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:39:32 user nova-compute[75006]: INFO nova.virt.block_device [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Booting with volume snapshot ac1e94b9-2335-4ea9-9901-030a64722516 at /dev/vda
Nov 27 03:39:32 user nova-compute[75006]: DEBUG nova.policy [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee3d2a74e8748c1aa045cc93d4894e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b1b7443dc44f21ac89452277f326b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Successfully created port: 95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Successfully updated port: 95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquired lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-570f3092-60d5-4dc3-bbe1-140971e6f67a req-68911fb6-838a-490e-85af-13dcc07e8859 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received event network-changed-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-570f3092-60d5-4dc3-bbe1-140971e6f67a req-68911fb6-838a-490e-85af-13dcc07e8859 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Refreshing instance network info cache due to event network-changed-95b5217a-7f5a-4804-aef0-a24a0a69dc42. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-570f3092-60d5-4dc3-bbe1-140971e6f67a req-68911fb6-838a-490e-85af-13dcc07e8859 service nova] Acquiring lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:39:33 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:39:34 user nova-compute[75006]: DEBUG nova.network.neutron [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Updating instance_info_cache with network_info: [{"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:39:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Releasing lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:39:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Instance network_info: |[{"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:39:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-570f3092-60d5-4dc3-bbe1-140971e6f67a req-68911fb6-838a-490e-85af-13dcc07e8859 service nova] Acquired lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:39:34 user nova-compute[75006]: DEBUG nova.network.neutron [req-570f3092-60d5-4dc3-bbe1-140971e6f67a req-68911fb6-838a-490e-85af-13dcc07e8859 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Refreshing network info cache for port 95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:39:34 user nova-compute[75006]: DEBUG nova.network.neutron [req-570f3092-60d5-4dc3-bbe1-140971e6f67a req-68911fb6-838a-490e-85af-13dcc07e8859 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Updated VIF entry in instance network info cache for port 95b5217a-7f5a-4804-aef0-a24a0a69dc42. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:39:34 user nova-compute[75006]: DEBUG nova.network.neutron [req-570f3092-60d5-4dc3-bbe1-140971e6f67a req-68911fb6-838a-490e-85af-13dcc07e8859 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Updating instance_info_cache with network_info: [{"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:39:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-570f3092-60d5-4dc3-bbe1-140971e6f67a req-68911fb6-838a-490e-85af-13dcc07e8859 service nova] Releasing lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:39:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG os_brick.utils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8555a72b-a3c1-4544-9d00-96f953042f10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2cd864-fec6-467e-919f-3626cc4c561f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b97477a-014a-467f-b080-4bc8158ca6f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd37ae74-142b-4e5f-9aeb-b1d448d6bff9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:39:38 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:39:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a275509-d907-4111-85e4-85e7e65fd5fc]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG os_brick.utils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:39:38 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Updating existing volume attachment record: 209c3880-d53d-425a-a44e-69e88c6da18e {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:39:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:39:44 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Creating image(s)
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Ensure instance console log exists: /opt/stack/data/nova/instances/1184d774-d1f5-4e67-91ad-7931cfe7d077/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Start _get_guest_xml network_info=[{"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-27T03:39:27Z,direct_url=<?>,disk_format='qcow2',id=e26fe5dc-5466-4369-9dba-0385d0823ddd,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-339535485',owner='46b1b7443dc44f21ac89452277f326b1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-27T03:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '209c3880-d53d-425a-a44e-69e88c6da18e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVahtFBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1184d774-d1f5-4e67-91ad-7931cfe7d077', 'attached_at': '', 'detached_at': '', 'volume_id': '4ec138b8-26c1-4954-b189-2dc445c79297', 'serial': '4ec138b8-26c1-4954-b189-2dc445c79297'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:39:44 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:39:44 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-27T03:39:27Z,direct_url=<?>,disk_format='qcow2',id=e26fe5dc-5466-4369-9dba-0385d0823ddd,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-339535485',owner='46b1b7443dc44f21ac89452277f326b1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-27T03:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVahtFBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:39:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:39:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:39:44 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd2e562-16fb-46ec-b5ad-74cc0f1419f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:39:44 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd127d-8deb-4f67-9bcb-00863e12e36f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297] added
Nov 27 03:39:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[462ffbbb-5075-402f-98f4-d726a44d8d5d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f963fd9-fb2e-44cc-963a-66852cfa1068]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GVahtFBf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GVahtFBf" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[648782de-3629-4343-bf3d-476776f0bbd3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GVahtFBf'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[189f1e5f-fb32-4ee1-9f7e-84cdf1cd9476]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57f3185-a5d8-4329-8313-77ec706fbc21]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:39:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:39:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a0c5e1-665c-4693-9bc2-a642b17f97bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297, portal: 172.16.0.220,3260]
Nov 27 03:39:44 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297, portal: 172.16.0.220,3260] successful.
Nov 27 03:39:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9314d9a4-fcd2-476b-9232-e70dd0a885fc]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[418bf970-9197-4bb0-9ae9-fd1ec3cbe1d5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)
Nov 27 03:39:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:39:44 user nova-compute[75006]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)
Nov 27 03:39:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[029dc1b0-0c7a-4186-9cfa-280cb2e5cf8b]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:39:44 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVahtFBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23065316137386366', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065316137386366', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1098797312',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1098797312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1098797312',id=44,image_ref='e26fe5dc-5466-4369-9dba-0385d0823ddd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhC1OsFMtMUj5FOff+tCNGk5AmrYhToicpt6GmtYSpHmkKQQTHIZB+8LPzS2rKMAsh+Ycpz1w7FGFHHYEAhYKlLxNkx1x51S5N9IlB826824okh+2fHOc4iZzm63spoSA==',key_name='tempest-keypair-1238445082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-lq7atmv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1716945418',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=1184d774-d1f5-4e67-91ad-7931cfe7d077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95b5217a-7f5a-4804-aef0-a24a0a69dc42,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b5217a-7f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.objects.instance [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'pci_devices' on Instance uuid 1184d774-d1f5-4e67-91ad-7931cfe7d077 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:39:45 user nova-compute[75006]:   <uuid>1184d774-d1f5-4e67-91ad-7931cfe7d077</uuid>
Nov 27 03:39:45 user nova-compute[75006]:   <name>instance-0000002c</name>
Nov 27 03:39:45 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:39:45 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:39:45 user nova-compute[75006]:   <metadata>
Nov 27 03:39:45 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:39:45 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:39:45 user nova-compute[75006]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1098797312</nova:name>
Nov 27 03:39:45 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:39:44</nova:creationTime>
Nov 27 03:39:45 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:39:45 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:39:45 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:39:45 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:39:45 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:39:45 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:39:45 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:39:45 user nova-compute[75006]:       <nova:owner>
Nov 27 03:39:45 user nova-compute[75006]:         <nova:user uuid="bee3d2a74e8748c1aa045cc93d4894e5">tempest-TestVolumeBootPattern-1716945418-project-member</nova:user>
Nov 27 03:39:45 user nova-compute[75006]:         <nova:project uuid="46b1b7443dc44f21ac89452277f326b1">tempest-TestVolumeBootPattern-1716945418</nova:project>
Nov 27 03:39:45 user nova-compute[75006]:       </nova:owner>
Nov 27 03:39:45 user nova-compute[75006]:       <nova:root type="image" uuid="e26fe5dc-5466-4369-9dba-0385d0823ddd"/>
Nov 27 03:39:45 user nova-compute[75006]:       <nova:ports>
Nov 27 03:39:45 user nova-compute[75006]:         <nova:port uuid="95b5217a-7f5a-4804-aef0-a24a0a69dc42">
Nov 27 03:39:45 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 03:39:45 user nova-compute[75006]:         </nova:port>
Nov 27 03:39:45 user nova-compute[75006]:       </nova:ports>
Nov 27 03:39:45 user nova-compute[75006]:     </nova:instance>
Nov 27 03:39:45 user nova-compute[75006]:   </metadata>
Nov 27 03:39:45 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:39:45 user nova-compute[75006]:     <system>
Nov 27 03:39:45 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:39:45 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:39:45 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:39:45 user nova-compute[75006]:       <entry name="serial">1184d774-d1f5-4e67-91ad-7931cfe7d077</entry>
Nov 27 03:39:45 user nova-compute[75006]:       <entry name="uuid">1184d774-d1f5-4e67-91ad-7931cfe7d077</entry>
Nov 27 03:39:45 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:39:45 user nova-compute[75006]:     </system>
Nov 27 03:39:45 user nova-compute[75006]:   </sysinfo>
Nov 27 03:39:45 user nova-compute[75006]:   <os>
Nov 27 03:39:45 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:39:45 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:39:45 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:39:45 user nova-compute[75006]:   </os>
Nov 27 03:39:45 user nova-compute[75006]:   <features>
Nov 27 03:39:45 user nova-compute[75006]:     <acpi/>
Nov 27 03:39:45 user nova-compute[75006]:     <apic/>
Nov 27 03:39:45 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:39:45 user nova-compute[75006]:   </features>
Nov 27 03:39:45 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:39:45 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:39:45 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:39:45 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:39:45 user nova-compute[75006]:   </clock>
Nov 27 03:39:45 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:39:45 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:39:45 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:39:45 user nova-compute[75006]:   </cpu>
Nov 27 03:39:45 user nova-compute[75006]:   <devices>
Nov 27 03:39:45 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:39:45 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:39:45 user nova-compute[75006]:       <source dev="/dev/sde"/>
Nov 27 03:39:45 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:39:45 user nova-compute[75006]:       <serial>4ec138b8-26c1-4954-b189-2dc445c79297</serial>
Nov 27 03:39:45 user nova-compute[75006]:     </disk>
Nov 27 03:39:45 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:39:45 user nova-compute[75006]:       <mac address="fa:16:3e:a0:7c:ff"/>
Nov 27 03:39:45 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:39:45 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:39:45 user nova-compute[75006]:       <target dev="tap95b5217a-7f"/>
Nov 27 03:39:45 user nova-compute[75006]:     </interface>
Nov 27 03:39:45 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:39:45 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/1184d774-d1f5-4e67-91ad-7931cfe7d077/console.log" append="off"/>
Nov 27 03:39:45 user nova-compute[75006]:     </serial>
Nov 27 03:39:45 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:39:45 user nova-compute[75006]:     <video>
Nov 27 03:39:45 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:39:45 user nova-compute[75006]:     </video>
Nov 27 03:39:45 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:39:45 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:39:45 user nova-compute[75006]:     </rng>
Nov 27 03:39:45 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:39:45 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:39:45 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:39:45 user nova-compute[75006]:     </memballoon>
Nov 27 03:39:45 user nova-compute[75006]:   </devices>
Nov 27 03:39:45 user nova-compute[75006]: </domain>
Nov 27 03:39:45 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1098797312',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1098797312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1098797312',id=44,image_ref='e26fe5dc-5466-4369-9dba-0385d0823ddd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhC1OsFMtMUj5FOff+tCNGk5AmrYhToicpt6GmtYSpHmkKQQTHIZB+8LPzS2rKMAsh+Ycpz1w7FGFHHYEAhYKlLxNkx1x51S5N9IlB826824okh+2fHOc4iZzm63spoSA==',key_name='tempest-keypair-1238445082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-lq7atmv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1716945418',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=1184d774-d1f5-4e67-91ad-7931cfe7d077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95b5217a-7f5a-4804-aef0-a24a0a69dc42,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b5217a-7f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG os_vif [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95b5217a-7f5a-4804-aef0-a24a0a69dc42,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b5217a-7f') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e63552c8-fa4a-5c0c-8078-d3e5f55ebd5d', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95b5217a-7f, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95b5217a-7f, col_values=(('qos', UUID('8839b14c-9b2b-48ec-aa73-e6cbc2fda54c')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95b5217a-7f, col_values=(('external_ids', {'iface-id': '95b5217a-7f5a-4804-aef0-a24a0a69dc42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:7c:ff', 'vm-uuid': '1184d774-d1f5-4e67-91ad-7931cfe7d077'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:45 user nova-compute[75006]: INFO os_vif [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95b5217a-7f5a-4804-aef0-a24a0a69dc42,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b5217a-7f')
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:39:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No VIF found with MAC fa:16:3e:a0:7c:ff, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-2c9b2b19-b24c-432f-84cd-9a0e6768401d req-6fe8e23e-12a5-400e-9a77-c7a666455675 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received event network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2c9b2b19-b24c-432f-84cd-9a0e6768401d req-6fe8e23e-12a5-400e-9a77-c7a666455675 service nova] Acquiring lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2c9b2b19-b24c-432f-84cd-9a0e6768401d req-6fe8e23e-12a5-400e-9a77-c7a666455675 service nova] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2c9b2b19-b24c-432f-84cd-9a0e6768401d req-6fe8e23e-12a5-400e-9a77-c7a666455675 service nova] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-2c9b2b19-b24c-432f-84cd-9a0e6768401d req-6fe8e23e-12a5-400e-9a77-c7a666455675 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] No waiting events found dispatching network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:39:47 user nova-compute[75006]: WARNING nova.compute.manager [req-2c9b2b19-b24c-432f-84cd-9a0e6768401d req-6fe8e23e-12a5-400e-9a77-c7a666455675 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received unexpected event network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 for instance with vm_state building and task_state spawning.
Nov 27 03:39:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:39:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:39:49 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Instance spawned successfully.
Nov 27 03:39:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:39:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:39:49 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:39:49 user nova-compute[75006]: INFO nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 27 03:39:49 user nova-compute[75006]: DEBUG nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:39:49 user nova-compute[75006]: INFO nova.compute.manager [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Took 17.40 seconds to build instance.
Nov 27 03:39:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-f7caca36-4f6e-43af-918d-5ec749b5de4d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.497s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-ba450a3a-79a1-4d0e-9791-2cfdaa28c759 req-13d25357-126e-4576-88a6-113ce570e4fa service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received event network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:39:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ba450a3a-79a1-4d0e-9791-2cfdaa28c759 req-13d25357-126e-4576-88a6-113ce570e4fa service nova] Acquiring lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:39:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ba450a3a-79a1-4d0e-9791-2cfdaa28c759 req-13d25357-126e-4576-88a6-113ce570e4fa service nova] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:39:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-ba450a3a-79a1-4d0e-9791-2cfdaa28c759 req-13d25357-126e-4576-88a6-113ce570e4fa service nova] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:39:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-ba450a3a-79a1-4d0e-9791-2cfdaa28c759 req-13d25357-126e-4576-88a6-113ce570e4fa service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] No waiting events found dispatching network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:39:49 user nova-compute[75006]: WARNING nova.compute.manager [req-ba450a3a-79a1-4d0e-9791-2cfdaa28c759 req-13d25357-126e-4576-88a6-113ce570e4fa service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received unexpected event network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 for instance with vm_state active and task_state None.
Nov 27 03:39:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:39:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:39:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:01 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:01 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:01 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:40:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:40:02 user nova-compute[75006]: INFO nova.compute.claims [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Claim successful on node user
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.704s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:40:03 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:40:03 user nova-compute[75006]: INFO nova.virt.block_device [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Booting with volume 23b29040-6513-48c6-9738-266741f4983f at /dev/vda
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.policy [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4a327fa49cc468f8cbf23ae2d6d30d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa566d4c0fd4cbdbaf2b67ac2cea59a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG os_brick.utils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9bdda5-68a5-42a5-9778-33e2dc8c3f2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65c7e16-ae67-4cc0-bc6f-15971eb6fdb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[740a2d6d-61c2-46aa-96ca-9bec601ab952]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceacbe3-797e-48b6-998d-5497b1253bde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:40:03 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebefb46c-3918-43b8-b3ee-4f8b1ab0c56b]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG os_brick.utils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating existing volume attachment record: 42097140-8017-4354-b0e4-b03073dd48ac {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.network.neutron [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Successfully created port: cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:40:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:40:04 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8092MB free_disk=24.98072052001953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6ae5f39a-0c6d-4538-b358-1eb6c753f442 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 326427b4-70bc-49e0-ae50-b8daf2c3421a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 1184d774-d1f5-4e67-91ad-7931cfe7d077 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 21797e41-8096-4cad-bb21-e877b40115eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:40:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Successfully updated port: cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquired lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-8c01ae1c-e144-443c-bd9c-afc48639aa4c req-72ed1ed9-5f86-478a-aaad-da676f3dd49a service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-changed-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-8c01ae1c-e144-443c-bd9c-afc48639aa4c req-72ed1ed9-5f86-478a-aaad-da676f3dd49a service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Refreshing instance network info cache due to event network-changed-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8c01ae1c-e144-443c-bd9c-afc48639aa4c req-72ed1ed9-5f86-478a-aaad-da676f3dd49a service nova] Acquiring lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Releasing lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance network_info: |[{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8c01ae1c-e144-443c-bd9c-afc48639aa4c req-72ed1ed9-5f86-478a-aaad-da676f3dd49a service nova] Acquired lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-8c01ae1c-e144-443c-bd9c-afc48639aa4c req-72ed1ed9-5f86-478a-aaad-da676f3dd49a service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Refreshing network info cache for port cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-8c01ae1c-e144-443c-bd9c-afc48639aa4c req-72ed1ed9-5f86-478a-aaad-da676f3dd49a service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updated VIF entry in instance network info cache for port cb9a8411-fa00-4a4d-bea2-ede8472b9ec4. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.network.neutron [req-8c01ae1c-e144-443c-bd9c-afc48639aa4c req-72ed1ed9-5f86-478a-aaad-da676f3dd49a service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8c01ae1c-e144-443c-bd9c-afc48639aa4c req-72ed1ed9-5f86-478a-aaad-da676f3dd49a service nova] Releasing lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:40:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:40:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updating instance_info_cache with network_info: [{"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:40:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-55bfa775-09a3-40d5-a361-8c88466bfeb2" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:40:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:40:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:40:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:11 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:40:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Creating image(s)
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Ensure instance console log exists: /opt/stack/data/nova/instances/21797e41-8096-4cad-bb21-e877b40115eb/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Start _get_guest_xml network_info=[{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '42097140-8017-4354-b0e4-b03073dd48ac', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqCirFpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '21797e41-8096-4cad-bb21-e877b40115eb', 'attached_at': '', 'detached_at': '', 'volume_id': '23b29040-6513-48c6-9738-266741f4983f', 'serial': '23b29040-6513-48c6-9738-266741f4983f'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:40:13 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:40:13 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqCirFpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:40:13 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:40:13 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:40:13 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b6e0f6-db12-4fa4-89e4-d0dc4157df4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:40:13 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9b749c-1556-45ea-9cb7-d74bea5d5185]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f] added
Nov 27 03:40:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b6bfc-c748-4ee3-8390-05d4c55b4815]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[288b28cd-2f4a-4b1f-80c9-2dcbe34f3de0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqCirFpx {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqCirFpx" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e0209-664b-4056-95b5-e4730678bd70]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fqCirFpx'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[06517186-d3ce-4727-8603-40e6a840a7cc]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95769d1-596b-4065-a6b3-8ef2230b0528]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)
Nov 27 03:40:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)
Nov 27 03:40:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4416774c-1dba-465a-9f81-43b477816ca5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260]
Nov 27 03:40:13 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260] successful.
Nov 27 03:40:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc36eb-f3fb-4c7b-a019-3b22096b64fc]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70d12a6-5ee8-4027-b947-59cc5b883180]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:40:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)
Nov 27 03:40:13 user nova-compute[75006]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:40:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8470ae69-3a83-40dd-9c09-445a4c130d3c]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:40:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqCirFpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23830336336623761', 'path': '/dev/sdf'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830336336623761', 'path': '/dev/sdf'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1522594165',display_name='tempest-ServerActionsTestOtherA-server-1522594165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1522594165',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-s8g0wxwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=21797e41-8096-4cad-bb21-e877b40115eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.objects.instance [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'pci_devices' on Instance uuid 21797e41-8096-4cad-bb21-e877b40115eb {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:40:14 user nova-compute[75006]:   <uuid>21797e41-8096-4cad-bb21-e877b40115eb</uuid>
Nov 27 03:40:14 user nova-compute[75006]:   <name>instance-0000002d</name>
Nov 27 03:40:14 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:40:14 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:40:14 user nova-compute[75006]:   <metadata>
Nov 27 03:40:14 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:40:14 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:40:14 user nova-compute[75006]:       <nova:name>tempest-ServerActionsTestOtherA-server-1522594165</nova:name>
Nov 27 03:40:14 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:40:13</nova:creationTime>
Nov 27 03:40:14 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:40:14 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:40:14 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:40:14 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:40:14 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:40:14 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:40:14 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:40:14 user nova-compute[75006]:       <nova:owner>
Nov 27 03:40:14 user nova-compute[75006]:         <nova:user uuid="d4a327fa49cc468f8cbf23ae2d6d30d1">tempest-ServerActionsTestOtherA-507729530-project-member</nova:user>
Nov 27 03:40:14 user nova-compute[75006]:         <nova:project uuid="daa566d4c0fd4cbdbaf2b67ac2cea59a">tempest-ServerActionsTestOtherA-507729530</nova:project>
Nov 27 03:40:14 user nova-compute[75006]:       </nova:owner>
Nov 27 03:40:14 user nova-compute[75006]:       <nova:ports>
Nov 27 03:40:14 user nova-compute[75006]:         <nova:port uuid="cb9a8411-fa00-4a4d-bea2-ede8472b9ec4">
Nov 27 03:40:14 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 03:40:14 user nova-compute[75006]:         </nova:port>
Nov 27 03:40:14 user nova-compute[75006]:       </nova:ports>
Nov 27 03:40:14 user nova-compute[75006]:     </nova:instance>
Nov 27 03:40:14 user nova-compute[75006]:   </metadata>
Nov 27 03:40:14 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:40:14 user nova-compute[75006]:     <system>
Nov 27 03:40:14 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:40:14 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:40:14 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:40:14 user nova-compute[75006]:       <entry name="serial">21797e41-8096-4cad-bb21-e877b40115eb</entry>
Nov 27 03:40:14 user nova-compute[75006]:       <entry name="uuid">21797e41-8096-4cad-bb21-e877b40115eb</entry>
Nov 27 03:40:14 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:40:14 user nova-compute[75006]:     </system>
Nov 27 03:40:14 user nova-compute[75006]:   </sysinfo>
Nov 27 03:40:14 user nova-compute[75006]:   <os>
Nov 27 03:40:14 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:40:14 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:40:14 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:40:14 user nova-compute[75006]:   </os>
Nov 27 03:40:14 user nova-compute[75006]:   <features>
Nov 27 03:40:14 user nova-compute[75006]:     <acpi/>
Nov 27 03:40:14 user nova-compute[75006]:     <apic/>
Nov 27 03:40:14 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:40:14 user nova-compute[75006]:   </features>
Nov 27 03:40:14 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:40:14 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:40:14 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:40:14 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:40:14 user nova-compute[75006]:   </clock>
Nov 27 03:40:14 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:40:14 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:40:14 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:40:14 user nova-compute[75006]:   </cpu>
Nov 27 03:40:14 user nova-compute[75006]:   <devices>
Nov 27 03:40:14 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:40:14 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:40:14 user nova-compute[75006]:       <source dev="/dev/sdf"/>
Nov 27 03:40:14 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:40:14 user nova-compute[75006]:       <serial>23b29040-6513-48c6-9738-266741f4983f</serial>
Nov 27 03:40:14 user nova-compute[75006]:     </disk>
Nov 27 03:40:14 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:40:14 user nova-compute[75006]:       <mac address="fa:16:3e:63:b4:49"/>
Nov 27 03:40:14 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:40:14 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:40:14 user nova-compute[75006]:       <target dev="tapcb9a8411-fa"/>
Nov 27 03:40:14 user nova-compute[75006]:     </interface>
Nov 27 03:40:14 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:40:14 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/21797e41-8096-4cad-bb21-e877b40115eb/console.log" append="off"/>
Nov 27 03:40:14 user nova-compute[75006]:     </serial>
Nov 27 03:40:14 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:40:14 user nova-compute[75006]:     <video>
Nov 27 03:40:14 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:40:14 user nova-compute[75006]:     </video>
Nov 27 03:40:14 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:40:14 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:40:14 user nova-compute[75006]:     </rng>
Nov 27 03:40:14 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:40:14 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:40:14 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:40:14 user nova-compute[75006]:     </memballoon>
Nov 27 03:40:14 user nova-compute[75006]:   </devices>
Nov 27 03:40:14 user nova-compute[75006]: </domain>
Nov 27 03:40:14 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1522594165',display_name='tempest-ServerActionsTestOtherA-server-1522594165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1522594165',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-s8g0wxwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=21797e41-8096-4cad-bb21-e877b40115eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG os_vif [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85154c8f-1416-592d-89e5-38500bcb61c3', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb9a8411-fa, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb9a8411-fa, col_values=(('qos', UUID('82170119-5bbd-429d-8ac2-90fc0b6c4dfd')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb9a8411-fa, col_values=(('external_ids', {'iface-id': 'cb9a8411-fa00-4a4d-bea2-ede8472b9ec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:b4:49', 'vm-uuid': '21797e41-8096-4cad-bb21-e877b40115eb'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:40:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:14 user nova-compute[75006]: INFO os_vif [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa')
Nov 27 03:40:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:40:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No VIF found with MAC fa:16:3e:63:b4:49, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:40:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-a8c8d07b-8ea7-4d75-bf75-5014c673bd65 req-4d3647d3-874e-4246-8817-73199efaee5f service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a8c8d07b-8ea7-4d75-bf75-5014c673bd65 req-4d3647d3-874e-4246-8817-73199efaee5f service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a8c8d07b-8ea7-4d75-bf75-5014c673bd65 req-4d3647d3-874e-4246-8817-73199efaee5f service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a8c8d07b-8ea7-4d75-bf75-5014c673bd65 req-4d3647d3-874e-4246-8817-73199efaee5f service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG nova.compute.manager [req-a8c8d07b-8ea7-4d75-bf75-5014c673bd65 req-4d3647d3-874e-4246-8817-73199efaee5f service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:16 user nova-compute[75006]: WARNING nova.compute.manager [req-a8c8d07b-8ea7-4d75-bf75-5014c673bd65 req-4d3647d3-874e-4246-8817-73199efaee5f service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state building and task_state spawning.
Nov 27 03:40:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-e2e189c8-c7eb-4a98-9737-00e3fa156676 req-46cc3be7-f66e-48a5-a25a-de7503e294a1 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2e189c8-c7eb-4a98-9737-00e3fa156676 req-46cc3be7-f66e-48a5-a25a-de7503e294a1 service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2e189c8-c7eb-4a98-9737-00e3fa156676 req-46cc3be7-f66e-48a5-a25a-de7503e294a1 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e2e189c8-c7eb-4a98-9737-00e3fa156676 req-46cc3be7-f66e-48a5-a25a-de7503e294a1 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-e2e189c8-c7eb-4a98-9737-00e3fa156676 req-46cc3be7-f66e-48a5-a25a-de7503e294a1 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:18 user nova-compute[75006]: WARNING nova.compute.manager [req-e2e189c8-c7eb-4a98-9737-00e3fa156676 req-46cc3be7-f66e-48a5-a25a-de7503e294a1 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state building and task_state spawning.
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:40:18 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance spawned successfully.
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:18 user nova-compute[75006]: INFO nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 27 03:40:18 user nova-compute[75006]: DEBUG nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:40:18 user nova-compute[75006]: INFO nova.compute.manager [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Took 16.41 seconds to build instance.
Nov 27 03:40:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4a2846f2-0421-4b83-af6e-044504011780 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.517s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:20 user nova-compute[75006]: INFO nova.compute.manager [None req-b972dd08-c53a-4cfc-bfdc-68aa542a613b tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Unrescuing
Nov 27 03:40:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b972dd08-c53a-4cfc-bfdc-68aa542a613b tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:40:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b972dd08-c53a-4cfc-bfdc-68aa542a613b tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquired lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:40:20 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b972dd08-c53a-4cfc-bfdc-68aa542a613b tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b972dd08-c53a-4cfc-bfdc-68aa542a613b tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Updating instance_info_cache with network_info: [{"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b972dd08-c53a-4cfc-bfdc-68aa542a613b tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Releasing lock "refresh_cache-6ae5f39a-0c6d-4538-b358-1eb6c753f442" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b972dd08-c53a-4cfc-bfdc-68aa542a613b tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'flavor' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8ccc0d0-2c17-4eff-8d2e-1a466a66f327 req-1a388956-aa71-4831-bd6d-8c77e53c982e service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8ccc0d0-2c17-4eff-8d2e-1a466a66f327 req-1a388956-aa71-4831-bd6d-8c77e53c982e service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8ccc0d0-2c17-4eff-8d2e-1a466a66f327 req-1a388956-aa71-4831-bd6d-8c77e53c982e service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e8ccc0d0-2c17-4eff-8d2e-1a466a66f327 req-1a388956-aa71-4831-bd6d-8c77e53c982e service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG nova.compute.manager [req-e8ccc0d0-2c17-4eff-8d2e-1a466a66f327 req-1a388956-aa71-4831-bd6d-8c77e53c982e service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:21 user nova-compute[75006]: WARNING nova.compute.manager [req-e8ccc0d0-2c17-4eff-8d2e-1a466a66f327 req-1a388956-aa71-4831-bd6d-8c77e53c982e service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:40:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:22 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance destroyed successfully.
Nov 27 03:40:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:23 user nova-compute[75006]: WARNING nova.compute.manager [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:40:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:23 user nova-compute[75006]: DEBUG nova.compute.manager [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:23 user nova-compute[75006]: WARNING nova.compute.manager [req-4642eed6-4c29-4cff-9cf9-348dd2b52e48 req-9fa56412-edc6-4fd5-9c4f-1b4e0457f4c2 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:40:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-c845e9e7-77b2-4201-a699-950e7643ff7e req-643eb3db-fef1-4c31-8df9-9131df79b7d4 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c845e9e7-77b2-4201-a699-950e7643ff7e req-643eb3db-fef1-4c31-8df9-9131df79b7d4 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c845e9e7-77b2-4201-a699-950e7643ff7e req-643eb3db-fef1-4c31-8df9-9131df79b7d4 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c845e9e7-77b2-4201-a699-950e7643ff7e req-643eb3db-fef1-4c31-8df9-9131df79b7d4 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-c845e9e7-77b2-4201-a699-950e7643ff7e req-643eb3db-fef1-4c31-8df9-9131df79b7d4 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:25 user nova-compute[75006]: WARNING nova.compute.manager [req-c845e9e7-77b2-4201-a699-950e7643ff7e req-643eb3db-fef1-4c31-8df9-9131df79b7d4 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state rescued and task_state unrescuing.
Nov 27 03:40:25 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b972dd08-c53a-4cfc-bfdc-68aa542a613b tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:40:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:40:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "64353d25-011c-46d5-955b-9da38d13587d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "64353d25-011c-46d5-955b-9da38d13587d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:38 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:40:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:38 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:40:38 user nova-compute[75006]: INFO nova.compute.claims [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Claim successful on node user
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:40:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.policy [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd22e79cc003141f6a9c6a414d2efb24c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53329447e46e476591953013fb8182a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:40:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Creating image(s)
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "/opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "/opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "/opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk 1073741824" returned: 0 in 0.084s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Successfully created port: db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Cannot resize image /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Ensure instance console log exists: /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Successfully updated port: db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "refresh_cache-64353d25-011c-46d5-955b-9da38d13587d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquired lock "refresh_cache-64353d25-011c-46d5-955b-9da38d13587d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-408fd3bb-1555-4aa5-82b7-25596d6777fb req-3a653c5d-24c5-4fbe-87aa-3aeed2f42bc7 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received event network-changed-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.compute.manager [req-408fd3bb-1555-4aa5-82b7-25596d6777fb req-3a653c5d-24c5-4fbe-87aa-3aeed2f42bc7 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Refreshing instance network info cache due to event network-changed-db9ba2a8-b3c6-49a3-b615-e9766e1f988f. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-408fd3bb-1555-4aa5-82b7-25596d6777fb req-3a653c5d-24c5-4fbe-87aa-3aeed2f42bc7 service nova] Acquiring lock "refresh_cache-64353d25-011c-46d5-955b-9da38d13587d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Updating instance_info_cache with network_info: [{"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Releasing lock "refresh_cache-64353d25-011c-46d5-955b-9da38d13587d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Instance network_info: |[{"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-408fd3bb-1555-4aa5-82b7-25596d6777fb req-3a653c5d-24c5-4fbe-87aa-3aeed2f42bc7 service nova] Acquired lock "refresh_cache-64353d25-011c-46d5-955b-9da38d13587d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.neutron [req-408fd3bb-1555-4aa5-82b7-25596d6777fb req-3a653c5d-24c5-4fbe-87aa-3aeed2f42bc7 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Refreshing network info cache for port db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Start _get_guest_xml network_info=[{"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:40:41 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:40:41 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1545251799',display_name='tempest-VolumesNegativeTest-instance-1545251799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1545251799',id=46,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53329447e46e476591953013fb8182a2',ramdisk_id='',reservation_id='r-dkqf5pc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-126857204',owner_user_name='tempest-VolumesNegativeTest-126857204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:40:39Z,user_data=None,user_id='d22e79cc003141f6a9c6a414d2efb24c',uuid=64353d25-011c-46d5-955b-9da38d13587d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Converting VIF {"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:10:87,bridge_name='br-int',has_traffic_filtering=True,id=db9ba2a8-b3c6-49a3-b615-e9766e1f988f,network=Network(52f14334-9e5c-4e8b-ba6b-a94840627db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9ba2a8-b3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lazy-loading 'pci_devices' on Instance uuid 64353d25-011c-46d5-955b-9da38d13587d {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:40:41 user nova-compute[75006]:   <uuid>64353d25-011c-46d5-955b-9da38d13587d</uuid>
Nov 27 03:40:41 user nova-compute[75006]:   <name>instance-0000002e</name>
Nov 27 03:40:41 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:40:41 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:40:41 user nova-compute[75006]:   <metadata>
Nov 27 03:40:41 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:40:41 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:40:41 user nova-compute[75006]:       <nova:name>tempest-VolumesNegativeTest-instance-1545251799</nova:name>
Nov 27 03:40:41 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:40:41</nova:creationTime>
Nov 27 03:40:41 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:40:41 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:40:41 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:40:41 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:40:41 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:40:41 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:40:41 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:40:41 user nova-compute[75006]:       <nova:owner>
Nov 27 03:40:41 user nova-compute[75006]:         <nova:user uuid="d22e79cc003141f6a9c6a414d2efb24c">tempest-VolumesNegativeTest-126857204-project-member</nova:user>
Nov 27 03:40:41 user nova-compute[75006]:         <nova:project uuid="53329447e46e476591953013fb8182a2">tempest-VolumesNegativeTest-126857204</nova:project>
Nov 27 03:40:41 user nova-compute[75006]:       </nova:owner>
Nov 27 03:40:41 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:40:41 user nova-compute[75006]:       <nova:ports>
Nov 27 03:40:41 user nova-compute[75006]:         <nova:port uuid="db9ba2a8-b3c6-49a3-b615-e9766e1f988f">
Nov 27 03:40:41 user nova-compute[75006]:           <nova:ip type="fixed" address="192.168.233.77" ipVersion="4"/>
Nov 27 03:40:41 user nova-compute[75006]:         </nova:port>
Nov 27 03:40:41 user nova-compute[75006]:       </nova:ports>
Nov 27 03:40:41 user nova-compute[75006]:     </nova:instance>
Nov 27 03:40:41 user nova-compute[75006]:   </metadata>
Nov 27 03:40:41 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:40:41 user nova-compute[75006]:     <system>
Nov 27 03:40:41 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:40:41 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:40:41 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:40:41 user nova-compute[75006]:       <entry name="serial">64353d25-011c-46d5-955b-9da38d13587d</entry>
Nov 27 03:40:41 user nova-compute[75006]:       <entry name="uuid">64353d25-011c-46d5-955b-9da38d13587d</entry>
Nov 27 03:40:41 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:40:41 user nova-compute[75006]:     </system>
Nov 27 03:40:41 user nova-compute[75006]:   </sysinfo>
Nov 27 03:40:41 user nova-compute[75006]:   <os>
Nov 27 03:40:41 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:40:41 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:40:41 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:40:41 user nova-compute[75006]:   </os>
Nov 27 03:40:41 user nova-compute[75006]:   <features>
Nov 27 03:40:41 user nova-compute[75006]:     <acpi/>
Nov 27 03:40:41 user nova-compute[75006]:     <apic/>
Nov 27 03:40:41 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:40:41 user nova-compute[75006]:   </features>
Nov 27 03:40:41 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:40:41 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:40:41 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:40:41 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:40:41 user nova-compute[75006]:   </clock>
Nov 27 03:40:41 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:40:41 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:40:41 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:40:41 user nova-compute[75006]:   </cpu>
Nov 27 03:40:41 user nova-compute[75006]:   <devices>
Nov 27 03:40:41 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:40:41 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:40:41 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk"/>
Nov 27 03:40:41 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:40:41 user nova-compute[75006]:     </disk>
Nov 27 03:40:41 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:40:41 user nova-compute[75006]:       <mac address="fa:16:3e:3c:10:87"/>
Nov 27 03:40:41 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:40:41 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:40:41 user nova-compute[75006]:       <target dev="tapdb9ba2a8-b3"/>
Nov 27 03:40:41 user nova-compute[75006]:     </interface>
Nov 27 03:40:41 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:40:41 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/console.log" append="off"/>
Nov 27 03:40:41 user nova-compute[75006]:     </serial>
Nov 27 03:40:41 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:40:41 user nova-compute[75006]:     <video>
Nov 27 03:40:41 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:40:41 user nova-compute[75006]:     </video>
Nov 27 03:40:41 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:40:41 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:40:41 user nova-compute[75006]:     </rng>
Nov 27 03:40:41 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:40:41 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:40:41 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:40:41 user nova-compute[75006]:     </memballoon>
Nov 27 03:40:41 user nova-compute[75006]:   </devices>
Nov 27 03:40:41 user nova-compute[75006]: </domain>
Nov 27 03:40:41 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1545251799',display_name='tempest-VolumesNegativeTest-instance-1545251799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1545251799',id=46,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53329447e46e476591953013fb8182a2',ramdisk_id='',reservation_id='r-dkqf5pc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-126857204',owner_user_name='tempest-VolumesNegativeTest-126857204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:40:39Z,user_data=None,user_id='d22e79cc003141f6a9c6a414d2efb24c',uuid=64353d25-011c-46d5-955b-9da38d13587d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Converting VIF {"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:10:87,bridge_name='br-int',has_traffic_filtering=True,id=db9ba2a8-b3c6-49a3-b615-e9766e1f988f,network=Network(52f14334-9e5c-4e8b-ba6b-a94840627db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9ba2a8-b3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG os_vif [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:10:87,bridge_name='br-int',has_traffic_filtering=True,id=db9ba2a8-b3c6-49a3-b615-e9766e1f988f,network=Network(52f14334-9e5c-4e8b-ba6b-a94840627db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9ba2a8-b3') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0226750-cb3e-578b-87ee-1cb2afcdfd27', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb9ba2a8-b3, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb9ba2a8-b3, col_values=(('qos', UUID('597d2ff8-da30-4587-ac51-cce334925c4a')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb9ba2a8-b3, col_values=(('external_ids', {'iface-id': 'db9ba2a8-b3c6-49a3-b615-e9766e1f988f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:10:87', 'vm-uuid': '64353d25-011c-46d5-955b-9da38d13587d'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: INFO os_vif [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:10:87,bridge_name='br-int',has_traffic_filtering=True,id=db9ba2a8-b3c6-49a3-b615-e9766e1f988f,network=Network(52f14334-9e5c-4e8b-ba6b-a94840627db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9ba2a8-b3')
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] No VIF found with MAC fa:16:3e:3c:10:87, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:41 user nova-compute[75006]: INFO nova.compute.manager [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Terminating instance
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.compute.manager [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.neutron [req-408fd3bb-1555-4aa5-82b7-25596d6777fb req-3a653c5d-24c5-4fbe-87aa-3aeed2f42bc7 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Updated VIF entry in instance network info cache for port db9ba2a8-b3c6-49a3-b615-e9766e1f988f. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG nova.network.neutron [req-408fd3bb-1555-4aa5-82b7-25596d6777fb req-3a653c5d-24c5-4fbe-87aa-3aeed2f42bc7 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Updating instance_info_cache with network_info: [{"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-408fd3bb-1555-4aa5-82b7-25596d6777fb req-3a653c5d-24c5-4fbe-87aa-3aeed2f42bc7 service nova] Releasing lock "refresh_cache-64353d25-011c-46d5-955b-9da38d13587d" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-a73b8ffd-4f08-474c-9f40-c648131f89d9 req-dc88763f-8892-4db2-a2d3-7d7f8322c0b5 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-unplugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a73b8ffd-4f08-474c-9f40-c648131f89d9 req-dc88763f-8892-4db2-a2d3-7d7f8322c0b5 service nova] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a73b8ffd-4f08-474c-9f40-c648131f89d9 req-dc88763f-8892-4db2-a2d3-7d7f8322c0b5 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a73b8ffd-4f08-474c-9f40-c648131f89d9 req-dc88763f-8892-4db2-a2d3-7d7f8322c0b5 service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-a73b8ffd-4f08-474c-9f40-c648131f89d9 req-dc88763f-8892-4db2-a2d3-7d7f8322c0b5 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] No waiting events found dispatching network-vif-unplugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-a73b8ffd-4f08-474c-9f40-c648131f89d9 req-dc88763f-8892-4db2-a2d3-7d7f8322c0b5 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-unplugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:40:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Instance destroyed successfully.
Nov 27 03:40:42 user nova-compute[75006]: DEBUG nova.objects.instance [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lazy-loading 'resources' on Instance uuid 326427b4-70bc-49e0-ae50-b8daf2c3421a {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T03:35:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1895041011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1895041011',id=41,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJme53BRSXGv3FeW1R3zk9QGe+0Jem0+Jlf8BC9dvh0w+itxwcCsWMDyK6Am6GIFd5Qrn90XKlHZNkRy+MEGyAVQNFerPfmm0gojGtZ13OJJwnz4rXkcqx3ty1FaH+EjTg==',key_name='tempest-keypair-1897998770',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:39:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8891478cee7d4a89bd27cd45a9732ac9',ramdisk_id='',reservation_id='r-umhbpt7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-392586266',owner_user_name='tempest-AttachVolumeShelveTestJSON-392586266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6153e4e893d74cdcae25fae6db9fc589',uuid=326427b4-70bc-49e0-ae50-b8daf2c3421a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converting VIF {"id": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "address": "fa:16:3e:0f:92:25", "network": {"id": "c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-744700507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8891478cee7d4a89bd27cd45a9732ac9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaa6a3ce-84", "ovs_interfaceid": "eaa6a3ce-8452-4582-ad29-df86bdf610aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG os_vif [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaa6a3ce-84, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7267144d-22f7-4f3c-b7c5-93ed8c106c0d) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:40:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:42 user nova-compute[75006]: INFO os_vif [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:92:25,bridge_name='br-int',has_traffic_filtering=True,id=eaa6a3ce-8452-4582-ad29-df86bdf610aa,network=Network(c7dc1ad9-8efe-4c3a-bd23-0e98d73c4fe0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaa6a3ce-84')
Nov 27 03:40:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Deleting instance files /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a_del
Nov 27 03:40:42 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Deletion of /opt/stack/data/nova/instances/326427b4-70bc-49e0-ae50-b8daf2c3421a_del complete
Nov 27 03:40:43 user nova-compute[75006]: INFO nova.compute.manager [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 27 03:40:43 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:40:43 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Took 0.85 seconds to deallocate network for instance.
Nov 27 03:40:43 user nova-compute[75006]: DEBUG nova.compute.manager [req-6593132a-ff03-417e-be09-ba0fb818a7eb req-766ac0e3-9646-4a24-ba01-bb632a129e52 service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-deleted-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Acquiring lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] No waiting events found dispatching network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:44 user nova-compute[75006]: WARNING nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 326427b4-70bc-49e0-ae50-b8daf2c3421a] Received unexpected event network-vif-plugged-eaa6a3ce-8452-4582-ad29-df86bdf610aa for instance with vm_state deleted and task_state None.
Nov 27 03:40:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received event network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Acquiring lock "64353d25-011c-46d5-955b-9da38d13587d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] No waiting events found dispatching network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:44 user nova-compute[75006]: WARNING nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received unexpected event network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f for instance with vm_state building and task_state spawning.
Nov 27 03:40:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received event network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Acquiring lock "64353d25-011c-46d5-955b-9da38d13587d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] No waiting events found dispatching network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:40:44 user nova-compute[75006]: WARNING nova.compute.manager [req-312162e5-5ea1-404b-9970-8a78d850d89b req-211d6490-0f9e-49cc-803d-47f77bc5182c service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received unexpected event network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f for instance with vm_state building and task_state spawning.
Nov 27 03:40:44 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:44 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Deleted allocations for instance 326427b4-70bc-49e0-ae50-b8daf2c3421a
Nov 27 03:40:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-39988bc0-3d0e-4a06-9e04-99ef115c6f7f tempest-AttachVolumeShelveTestJSON-392586266 tempest-AttachVolumeShelveTestJSON-392586266-project-member] Lock "326427b4-70bc-49e0-ae50-b8daf2c3421a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.538s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:40:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Instance spawned successfully.
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:40:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:45 user nova-compute[75006]: INFO nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Took 6.08 seconds to spawn the instance on the hypervisor.
Nov 27 03:40:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:40:45 user nova-compute[75006]: INFO nova.compute.manager [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Took 6.77 seconds to build instance.
Nov 27 03:40:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3652b8f2-59c5-4654-ba06-911a8cce4a68 tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "64353d25-011c-46d5-955b-9da38d13587d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.856s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:40:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:40:58 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:01 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:01 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:01 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:41:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:41:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:41:03 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=7918MB free_disk=24.979373931884766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6ae5f39a-0c6d-4538-b358-1eb6c753f442 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 1184d774-d1f5-4e67-91ad-7931cfe7d077 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 21797e41-8096-4cad-bb21-e877b40115eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 64353d25-011c-46d5-955b-9da38d13587d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:41:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:41:04 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:41:04 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:41:04 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:41:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updating instance_info_cache with network_info: [{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:41:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:11 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:41:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-c506935c-4e81-4a31-bb44-0881ac79105c req-35c5c235-4acd-49f9-a2be-68b0d9523aef service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received event network-changed-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:22 user nova-compute[75006]: DEBUG nova.compute.manager [req-c506935c-4e81-4a31-bb44-0881ac79105c req-35c5c235-4acd-49f9-a2be-68b0d9523aef service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Refreshing instance network info cache due to event network-changed-95b5217a-7f5a-4804-aef0-a24a0a69dc42. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:41:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c506935c-4e81-4a31-bb44-0881ac79105c req-35c5c235-4acd-49f9-a2be-68b0d9523aef service nova] Acquiring lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:41:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c506935c-4e81-4a31-bb44-0881ac79105c req-35c5c235-4acd-49f9-a2be-68b0d9523aef service nova] Acquired lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:41:22 user nova-compute[75006]: DEBUG nova.network.neutron [req-c506935c-4e81-4a31-bb44-0881ac79105c req-35c5c235-4acd-49f9-a2be-68b0d9523aef service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Refreshing network info cache for port 95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:41:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG nova.network.neutron [req-c506935c-4e81-4a31-bb44-0881ac79105c req-35c5c235-4acd-49f9-a2be-68b0d9523aef service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Updated VIF entry in instance network info cache for port 95b5217a-7f5a-4804-aef0-a24a0a69dc42. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG nova.network.neutron [req-c506935c-4e81-4a31-bb44-0881ac79105c req-35c5c235-4acd-49f9-a2be-68b0d9523aef service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Updating instance_info_cache with network_info: [{"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c506935c-4e81-4a31-bb44-0881ac79105c req-35c5c235-4acd-49f9-a2be-68b0d9523aef service nova] Releasing lock "refresh_cache-1184d774-d1f5-4e67-91ad-7931cfe7d077" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "1184d774-d1f5-4e67-91ad-7931cfe7d077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:23 user nova-compute[75006]: INFO nova.compute.manager [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Terminating instance
Nov 27 03:41:23 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:24 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Instance destroyed successfully.
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'resources' on Instance uuid 1184d774-d1f5-4e67-91ad-7931cfe7d077 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1098797312',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1098797312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1098797312',id=44,image_ref='e26fe5dc-5466-4369-9dba-0385d0823ddd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhC1OsFMtMUj5FOff+tCNGk5AmrYhToicpt6GmtYSpHmkKQQTHIZB+8LPzS2rKMAsh+Ycpz1w7FGFHHYEAhYKlLxNkx1x51S5N9IlB826824okh+2fHOc4iZzm63spoSA==',key_name='tempest-keypair-1238445082',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:39:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-lq7atmv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1716945418',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=1184d774-d1f5-4e67-91ad-7931cfe7d077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "address": "fa:16:3e:a0:7c:ff", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95b5217a-7f", "ovs_interfaceid": "95b5217a-7f5a-4804-aef0-a24a0a69dc42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95b5217a-7f5a-4804-aef0-a24a0a69dc42,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b5217a-7f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_vif [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95b5217a-7f5a-4804-aef0-a24a0a69dc42,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b5217a-7f') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95b5217a-7f, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8839b14c-9b2b-48ec-aa73-e6cbc2fda54c) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:24 user nova-compute[75006]: INFO os_vif [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=95b5217a-7f5a-4804-aef0-a24a0a69dc42,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95b5217a-7f')
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GVahtFBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:41:24 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b43b73-ba7f-46cd-8edb-569c810a28be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:41:24 user nova-compute[75006]: No targets found.
Nov 27 03:41:24 user nova-compute[75006]: iSNS:
Nov 27 03:41:24 user nova-compute[75006]: No targets found.
Nov 27 03:41:24 user nova-compute[75006]: STATIC:
Nov 27 03:41:24 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:41:24 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:24 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:24 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a
Nov 27 03:41:24 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:24 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:24 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba
Nov 27 03:41:24 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:24 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:24 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:41:24 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:24 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:24 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297
Nov 27 03:41:24 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:24 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:24 user nova-compute[75006]: FIRMWARE:
Nov 27 03:41:24 user nova-compute[75006]: No targets found.
Nov 27 03:41:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:41:24 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:41:24 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[115b4e59-e765-4de9-a669-bc6cdfb5dcdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a464138-2c56-4abb-b727-d119407b5721]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:41:24 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:41:24 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:41:24 user nova-compute[75006]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)
Nov 27 03:41:24 user nova-compute[75006]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:41:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:41:24 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:41:24 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:41:24 user nova-compute[75006]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 (non-flash)
Nov 27 03:41:24 user nova-compute[75006]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:41:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4006d3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc887da5-caa9-4635-b4c7-8753b70de082]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2746cada-0ff2-4cb4-a369-0f81189f8861]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[528c8dd4-b3c6-4a5f-9ee0-08eff04ed366]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e80e9d-e0fb-4539-9916-1c3636955586]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b8d7d603', '/dev/disk/by-id/scsi-1SCST_BIOb8d7d603-0e1a78cfa1b56981', '/dev/disk/by-id/scsi-23065316137386366') {{(pid=85775) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c58b20-aef3-404e-8560-0c7c9a53d248]: (4, None) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[246b1191-6624-4e0a-9961-3d2d8c992ac1]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3759143e-3c36-46d7-886d-f50a9c068b07]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297, portal: 172.16.0.220,3260]
Nov 27 03:41:24 user nova-compute[75006]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297, portal: 172.16.0.220,3260] successful.
Nov 27 03:41:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ec138b8-26c1-4954-b189-2dc445c79297 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6b8b5d-6e02-4b83-bf10-7c61cdbd8a93]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== disconnect_volume: return (366ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:41:24 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Deleting instance files /opt/stack/data/nova/instances/1184d774-d1f5-4e67-91ad-7931cfe7d077_del
Nov 27 03:41:24 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Deletion of /opt/stack/data/nova/instances/1184d774-d1f5-4e67-91ad-7931cfe7d077_del complete
Nov 27 03:41:24 user nova-compute[75006]: INFO nova.compute.manager [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received event network-vif-unplugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] Acquiring lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] No waiting events found dispatching network-vif-unplugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received event network-vif-unplugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received event network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] Acquiring lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:24 user nova-compute[75006]: DEBUG nova.compute.manager [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] No waiting events found dispatching network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:41:24 user nova-compute[75006]: WARNING nova.compute.manager [req-994fffef-562d-4180-b2a6-8aca5faf5c04 req-1711539c-4757-4dd0-9a22-58ab3fc11807 service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received unexpected event network-vif-plugged-95b5217a-7f5a-4804-aef0-a24a0a69dc42 for instance with vm_state active and task_state deleting.
Nov 27 03:41:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:25 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:41:25 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Took 0.71 seconds to deallocate network for instance.
Nov 27 03:41:25 user nova-compute[75006]: DEBUG nova.compute.manager [req-40814d2e-09bf-4770-a819-e04c57100816 req-bca7f1f1-6f44-439c-8701-2a8b4be770ef service nova] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Received event network-vif-deleted-95b5217a-7f5a-4804-aef0-a24a0a69dc42 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:26 user nova-compute[75006]: INFO nova.compute.manager [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Took 0.72 seconds to detach 1 volumes for instance.
Nov 27 03:41:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 1184d774-d1f5-4e67-91ad-7931cfe7d077] Deleting volume: 4ec138b8-26c1-4954-b189-2dc445c79297 {{(pid=75006) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 03:41:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:26 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:41:26 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:41:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:27 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Deleted allocations for instance 1184d774-d1f5-4e67-91ad-7931cfe7d077
Nov 27 03:41:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3d3f0000-676b-407a-9c50-a4cb9c983334 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "1184d774-d1f5-4e67-91ad-7931cfe7d077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.635s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:41:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-bc6a2ee5-e5b4-4f0b-a885-6fdadaf7a3ff req-62333e43-5587-4108-b908-d9fba72f8597 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-changed-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:53 user nova-compute[75006]: DEBUG nova.compute.manager [req-bc6a2ee5-e5b4-4f0b-a885-6fdadaf7a3ff req-62333e43-5587-4108-b908-d9fba72f8597 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Refreshing instance network info cache due to event network-changed-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:41:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bc6a2ee5-e5b4-4f0b-a885-6fdadaf7a3ff req-62333e43-5587-4108-b908-d9fba72f8597 service nova] Acquiring lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:41:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bc6a2ee5-e5b4-4f0b-a885-6fdadaf7a3ff req-62333e43-5587-4108-b908-d9fba72f8597 service nova] Acquired lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:41:53 user nova-compute[75006]: DEBUG nova.network.neutron [req-bc6a2ee5-e5b4-4f0b-a885-6fdadaf7a3ff req-62333e43-5587-4108-b908-d9fba72f8597 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Refreshing network info cache for port 424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:41:53 user nova-compute[75006]: DEBUG nova.network.neutron [req-bc6a2ee5-e5b4-4f0b-a885-6fdadaf7a3ff req-62333e43-5587-4108-b908-d9fba72f8597 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updated VIF entry in instance network info cache for port 424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:41:53 user nova-compute[75006]: DEBUG nova.network.neutron [req-bc6a2ee5-e5b4-4f0b-a885-6fdadaf7a3ff req-62333e43-5587-4108-b908-d9fba72f8597 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updating instance_info_cache with network_info: [{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:41:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bc6a2ee5-e5b4-4f0b-a885-6fdadaf7a3ff req-62333e43-5587-4108-b908-d9fba72f8597 service nova] Releasing lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:41:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:41:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Stashing vm_state: active {{(pid=75006) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 27 03:41:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:41:55 user nova-compute[75006]: INFO nova.compute.claims [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Claim successful on node user
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-4b0ffb9e-c241-4b9a-be7e-8b2a6798e084 req-5d843c47-539e-41aa-b5c0-d44fc76a5240 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-changed-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-4b0ffb9e-c241-4b9a-be7e-8b2a6798e084 req-5d843c47-539e-41aa-b5c0-d44fc76a5240 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Refreshing instance network info cache due to event network-changed-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4b0ffb9e-c241-4b9a-be7e-8b2a6798e084 req-5d843c47-539e-41aa-b5c0-d44fc76a5240 service nova] Acquiring lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4b0ffb9e-c241-4b9a-be7e-8b2a6798e084 req-5d843c47-539e-41aa-b5c0-d44fc76a5240 service nova] Acquired lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-4b0ffb9e-c241-4b9a-be7e-8b2a6798e084 req-5d843c47-539e-41aa-b5c0-d44fc76a5240 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Refreshing network info cache for port cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:41:55 user nova-compute[75006]: INFO nova.compute.resource_tracker [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating resource usage from migration 1cba2def-fb80-4328-8aed-286af88a5ab7
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.708s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:55 user nova-compute[75006]: INFO nova.compute.manager [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Migrating
Nov 27 03:41:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-4b0ffb9e-c241-4b9a-be7e-8b2a6798e084 req-5d843c47-539e-41aa-b5c0-d44fc76a5240 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updated VIF entry in instance network info cache for port cb9a8411-fa00-4a4d-bea2-ede8472b9ec4. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-4b0ffb9e-c241-4b9a-be7e-8b2a6798e084 req-5d843c47-539e-41aa-b5c0-d44fc76a5240 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4b0ffb9e-c241-4b9a-be7e-8b2a6798e084 req-5d843c47-539e-41aa-b5c0-d44fc76a5240 service nova] Releasing lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquired lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:41:55 user nova-compute[75006]: DEBUG nova.network.neutron [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Releasing lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Starting migrate_disk_and_power_off {{(pid=75006) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-aeaa9d12-a51d-45a3-8f3d-bbcdf1329880 req-8ed79ad3-cf08-414d-b861-94ef9944e6d6 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aeaa9d12-a51d-45a3-8f3d-bbcdf1329880 req-8ed79ad3-cf08-414d-b861-94ef9944e6d6 service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aeaa9d12-a51d-45a3-8f3d-bbcdf1329880 req-8ed79ad3-cf08-414d-b861-94ef9944e6d6 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aeaa9d12-a51d-45a3-8f3d-bbcdf1329880 req-8ed79ad3-cf08-414d-b861-94ef9944e6d6 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-aeaa9d12-a51d-45a3-8f3d-bbcdf1329880 req-8ed79ad3-cf08-414d-b861-94ef9944e6d6 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:41:56 user nova-compute[75006]: WARNING nova.compute.manager [req-aeaa9d12-a51d-45a3-8f3d-bbcdf1329880 req-8ed79ad3-cf08-414d-b861-94ef9944e6d6 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state resize_migrating.
Nov 27 03:41:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance destroyed successfully.
Nov 27 03:41:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1522594165',display_name='tempest-ServerActionsTestOtherA-server-1522594165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1522594165',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-s8g0wxwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:41:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=21797e41-8096-4cad-bb21-e877b40115eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473983752-network", "vif_mac": "fa:16:3e:63:b4:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473983752-network", "vif_mac": "fa:16:3e:63:b4:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_vif [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb9a8411-fa, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82170119-5bbd-429d-8ac2-90fc0b6c4dfd) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: INFO os_vif [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa')
Nov 27 03:41:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqCirFpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:41:57 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[079d549c-60b7-4e62-9184-64d87d5d1332]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:41:57 user nova-compute[75006]: No targets found.
Nov 27 03:41:57 user nova-compute[75006]: iSNS:
Nov 27 03:41:57 user nova-compute[75006]: No targets found.
Nov 27 03:41:57 user nova-compute[75006]: STATIC:
Nov 27 03:41:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:41:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a
Nov 27 03:41:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba
Nov 27 03:41:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:57 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:41:57 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:41:57 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:41:57 user nova-compute[75006]: FIRMWARE:
Nov 27 03:41:57 user nova-compute[75006]: No targets found.
Nov 27 03:41:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:41:57 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:41:57 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcacd974-3790-417a-bb90-782112f4818b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cff5165-9e55-4a90-bf10-f271acfe6fde]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:41:57 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:41:57 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:41:57 user nova-compute[75006]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:41:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:41:57 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:41:57 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:41:57 user nova-compute[75006]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:41:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd44511b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f'): ({'sdf'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Removing single pathed devices sdf {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee92cfe-89e4-4447-a69e-b6dd17350496]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9d88ec-ea83-44c9-8a52-1fdaf9f4fec6]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flushing IO for device /dev/sdf {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c5b643-7996-4e61-be1b-93d790bc7ca6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9d853e-6579-4da1-891d-25ee69f0942d]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] SCSI volumes sdf have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f520045-9aa8-4652-ae66-db49b6215df1]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4e91a3-9501-4ffa-801c-8a4e3ba5187f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260]
Nov 27 03:41:57 user nova-compute[75006]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260] successful.
Nov 27 03:41:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c47351-11b9-42d3-9532-1364b3d69146]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== disconnect_volume: return (365ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Port cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 binding to destination host user is already ACTIVE {{(pid=75006) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:41:58 user nova-compute[75006]: WARNING nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state resize_migrating.
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:41:58 user nova-compute[75006]: WARNING nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state resize_migrating.
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:41:58 user nova-compute[75006]: WARNING nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state resize_migrating.
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:41:58 user nova-compute[75006]: WARNING nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state resize_migrating.
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:41:58 user nova-compute[75006]: WARNING nova.compute.manager [req-76f63ee2-af0e-4054-afde-fde3a7aa02d2 req-da9af2d8-86f6-45dc-b1ce-9faf09dac4ad service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state resize_migrating.
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquired lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:41:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Releasing lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG os_brick.utils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c6d2c-7914-4322-98c3-131c7e1d9859]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd14a2c-36f3-4543-aae1-5a57329b2b1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2971cb81-5a13-479a-9c25-6f9a548f8bad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8120ed92-6b1c-41aa-88e6-4a035da45778]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:41:59 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a643fe-c2c8-43b1-89dc-61280cc2df5a]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG os_brick.utils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:41:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:02 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:03 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:42:03 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:04 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:42:05 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:42:05 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8257MB free_disk=24.95914077758789GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Applying migration context for instance 21797e41-8096-4cad-bb21-e877b40115eb as it has an incoming, in-progress migration 1cba2def-fb80-4328-8aed-286af88a5ab7. Migration status is post-migrating {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 03:42:05 user nova-compute[75006]: INFO nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating resource usage from migration 1cba2def-fb80-4328-8aed-286af88a5ab7
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 54e46dc7-4d71-4720-9906-270ab0c872e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 6ae5f39a-0c6d-4538-b358-1eb6c753f442 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 64353d25-011c-46d5-955b-9da38d13587d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Migration 1cba2def-fb80-4328-8aed-286af88a5ab7 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 21797e41-8096-4cad-bb21-e877b40115eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:42:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:42:06 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:42:06 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:42:06 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:42:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:42:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:42:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:42:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:42:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Updating instance_info_cache with network_info: [{"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:42:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-54e46dc7-4d71-4720-9906-270ab0c872e7" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:42:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:42:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Starting finish_migration {{(pid=75006) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance directory exists: not creating {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 03:42:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Creating image(s)
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Ensure instance console log exists: /opt/stack/data/nova/instances/21797e41-8096-4cad-bb21-e877b40115eb/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Start _get_guest_xml network_info=[{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473983752-network", "vif_mac": "fa:16:3e:63:b4:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '44ac6a86-2ced-454a-a9ac-84eb6ac1e458', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqCirFpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '21797e41-8096-4cad-bb21-e877b40115eb', 'attached_at': '2023-11-27T03:42:09.000000', 'detached_at': '', 'volume_id': '23b29040-6513-48c6-9738-266741f4983f', 'serial': '23b29040-6513-48c6-9738-266741f4983f'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:42:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:42:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqCirFpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:42:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:42:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:42:09 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71f598d-0ea2-4ba0-9b6f-23badf63db76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:42:09 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25e06c7-178a-4b64-bb8c-c57ea7b0fc5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f] added
Nov 27 03:42:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[48343e3a-1438-422d-8805-ddf06cb6bdd4]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2140847-2aaf-43c3-884c-4d075e2848ba]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqCirFpx {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqCirFpx" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a755999-2539-4495-b536-7e39cfad05f0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fqCirFpx'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9950b-f3d2-4d65-966b-bfdfead1e449]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b812d231-f779-454a-996a-7e73a7a724ab]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:42:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:42:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0a69f-41ff-435f-b371-8a3dbf33150c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260]
Nov 27 03:42:09 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260] successful.
Nov 27 03:42:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5bf81-987d-4836-955d-b66d41268583]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[331301fc-0875-46ec-b76b-1217d601b58b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:42:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:42:09 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:42:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[18558839-d4bb-43ee-8605-a8390d239f5b]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqCirFpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23830336336623761', 'path': '/dev/sde'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830336336623761', 'path': '/dev/sde'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1522594165',display_name='tempest-ServerActionsTestOtherA-server-1522594165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1522594165',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-s8g0wxwt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=21797e41-8096-4cad-bb21-e877b40115eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473983752-network", "vif_mac": "fa:16:3e:63:b4:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473983752-network", "vif_mac": "fa:16:3e:63:b4:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:42:10 user nova-compute[75006]:   <uuid>21797e41-8096-4cad-bb21-e877b40115eb</uuid>
Nov 27 03:42:10 user nova-compute[75006]:   <name>instance-0000002d</name>
Nov 27 03:42:10 user nova-compute[75006]:   <memory>2097152</memory>
Nov 27 03:42:10 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:42:10 user nova-compute[75006]:   <metadata>
Nov 27 03:42:10 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:42:10 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:42:10 user nova-compute[75006]:       <nova:name>tempest-ServerActionsTestOtherA-server-1522594165</nova:name>
Nov 27 03:42:10 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:42:09</nova:creationTime>
Nov 27 03:42:10 user nova-compute[75006]:       <nova:flavor name="m1.small">
Nov 27 03:42:10 user nova-compute[75006]:         <nova:memory>2048</nova:memory>
Nov 27 03:42:10 user nova-compute[75006]:         <nova:disk>20</nova:disk>
Nov 27 03:42:10 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:42:10 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:42:10 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:42:10 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:42:10 user nova-compute[75006]:       <nova:owner>
Nov 27 03:42:10 user nova-compute[75006]:         <nova:user uuid="d4a327fa49cc468f8cbf23ae2d6d30d1">tempest-ServerActionsTestOtherA-507729530-project-member</nova:user>
Nov 27 03:42:10 user nova-compute[75006]:         <nova:project uuid="daa566d4c0fd4cbdbaf2b67ac2cea59a">tempest-ServerActionsTestOtherA-507729530</nova:project>
Nov 27 03:42:10 user nova-compute[75006]:       </nova:owner>
Nov 27 03:42:10 user nova-compute[75006]:       <nova:ports>
Nov 27 03:42:10 user nova-compute[75006]:         <nova:port uuid="cb9a8411-fa00-4a4d-bea2-ede8472b9ec4">
Nov 27 03:42:10 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 03:42:10 user nova-compute[75006]:         </nova:port>
Nov 27 03:42:10 user nova-compute[75006]:       </nova:ports>
Nov 27 03:42:10 user nova-compute[75006]:     </nova:instance>
Nov 27 03:42:10 user nova-compute[75006]:   </metadata>
Nov 27 03:42:10 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:42:10 user nova-compute[75006]:     <system>
Nov 27 03:42:10 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:42:10 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:42:10 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:42:10 user nova-compute[75006]:       <entry name="serial">21797e41-8096-4cad-bb21-e877b40115eb</entry>
Nov 27 03:42:10 user nova-compute[75006]:       <entry name="uuid">21797e41-8096-4cad-bb21-e877b40115eb</entry>
Nov 27 03:42:10 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:42:10 user nova-compute[75006]:     </system>
Nov 27 03:42:10 user nova-compute[75006]:   </sysinfo>
Nov 27 03:42:10 user nova-compute[75006]:   <os>
Nov 27 03:42:10 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:42:10 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:42:10 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:42:10 user nova-compute[75006]:   </os>
Nov 27 03:42:10 user nova-compute[75006]:   <features>
Nov 27 03:42:10 user nova-compute[75006]:     <acpi/>
Nov 27 03:42:10 user nova-compute[75006]:     <apic/>
Nov 27 03:42:10 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:42:10 user nova-compute[75006]:   </features>
Nov 27 03:42:10 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:42:10 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:42:10 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:42:10 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:42:10 user nova-compute[75006]:   </clock>
Nov 27 03:42:10 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:42:10 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:42:10 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:42:10 user nova-compute[75006]:   </cpu>
Nov 27 03:42:10 user nova-compute[75006]:   <devices>
Nov 27 03:42:10 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:42:10 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:42:10 user nova-compute[75006]:       <source dev="/dev/sde"/>
Nov 27 03:42:10 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:42:10 user nova-compute[75006]:       <serial>23b29040-6513-48c6-9738-266741f4983f</serial>
Nov 27 03:42:10 user nova-compute[75006]:     </disk>
Nov 27 03:42:10 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:42:10 user nova-compute[75006]:       <mac address="fa:16:3e:63:b4:49"/>
Nov 27 03:42:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:42:10 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:42:10 user nova-compute[75006]:       <target dev="tapcb9a8411-fa"/>
Nov 27 03:42:10 user nova-compute[75006]:     </interface>
Nov 27 03:42:10 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:42:10 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/21797e41-8096-4cad-bb21-e877b40115eb/console.log" append="off"/>
Nov 27 03:42:10 user nova-compute[75006]:     </serial>
Nov 27 03:42:10 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:42:10 user nova-compute[75006]:     <video>
Nov 27 03:42:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:42:10 user nova-compute[75006]:     </video>
Nov 27 03:42:10 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:42:10 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:42:10 user nova-compute[75006]:     </rng>
Nov 27 03:42:10 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:42:10 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:42:10 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:42:10 user nova-compute[75006]:     </memballoon>
Nov 27 03:42:10 user nova-compute[75006]:   </devices>
Nov 27 03:42:10 user nova-compute[75006]: </domain>
Nov 27 03:42:10 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1522594165',display_name='tempest-ServerActionsTestOtherA-server-1522594165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1522594165',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-s8g0wxwt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=21797e41-8096-4cad-bb21-e877b40115eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473983752-network", "vif_mac": "fa:16:3e:63:b4:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-473983752-network", "vif_mac": "fa:16:3e:63:b4:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG os_vif [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85154c8f-1416-592d-89e5-38500bcb61c3', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb9a8411-fa, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb9a8411-fa, col_values=(('qos', UUID('1912f153-3b53-482d-8213-01f196f544c1')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb9a8411-fa, col_values=(('external_ids', {'iface-id': 'cb9a8411-fa00-4a4d-bea2-ede8472b9ec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:b4:49', 'vm-uuid': '21797e41-8096-4cad-bb21-e877b40115eb'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:10 user nova-compute[75006]: INFO os_vif [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa')
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] No VIF found with MAC fa:16:3e:63:b4:49, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:11 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:11 user nova-compute[75006]: INFO nova.compute.manager [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Terminating instance
Nov 27 03:42:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-e4b6d8e3-7ef1-4099-af97-4b938cc1dc1c req-b5ee0a13-490f-4b05-8348-41452b479760 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4b6d8e3-7ef1-4099-af97-4b938cc1dc1c req-b5ee0a13-490f-4b05-8348-41452b479760 service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4b6d8e3-7ef1-4099-af97-4b938cc1dc1c req-b5ee0a13-490f-4b05-8348-41452b479760 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e4b6d8e3-7ef1-4099-af97-4b938cc1dc1c req-b5ee0a13-490f-4b05-8348-41452b479760 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-e4b6d8e3-7ef1-4099-af97-4b938cc1dc1c req-b5ee0a13-490f-4b05-8348-41452b479760 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:12 user nova-compute[75006]: WARNING nova.compute.manager [req-e4b6d8e3-7ef1-4099-af97-4b938cc1dc1c req-b5ee0a13-490f-4b05-8348-41452b479760 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state resize_finish.
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Instance destroyed successfully.
Nov 27 03:42:12 user nova-compute[75006]: DEBUG nova.objects.instance [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'resources' on Instance uuid 6ae5f39a-0c6d-4538-b358-1eb6c753f442 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1452538442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1452538442',id=42,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-kdywof2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:40:26Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=6ae5f39a-0c6d-4538-b358-1eb6c753f442,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "5c7595e4-d17a-4894-be14-84875dd85457", "address": "fa:16:3e:a2:0c:56", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7595e4-d1", "ovs_interfaceid": "5c7595e4-d17a-4894-be14-84875dd85457", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:0c:56,bridge_name='br-int',has_traffic_filtering=True,id=5c7595e4-d17a-4894-be14-84875dd85457,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7595e4-d1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_vif [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:0c:56,bridge_name='br-int',has_traffic_filtering=True,id=5c7595e4-d17a-4894-be14-84875dd85457,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7595e4-d1') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c7595e4-d1, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d608d860-f1cc-4fe2-962f-1be6ade92067) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:12 user nova-compute[75006]: INFO os_vif [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:0c:56,bridge_name='br-int',has_traffic_filtering=True,id=5c7595e4-d17a-4894-be14-84875dd85457,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7595e4-d1')
Nov 27 03:42:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtamYupB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:42:12 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711e6f1-1e7b-4585-ac70-1701f08967b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:42:12 user nova-compute[75006]: No targets found.
Nov 27 03:42:12 user nova-compute[75006]: iSNS:
Nov 27 03:42:12 user nova-compute[75006]: No targets found.
Nov 27 03:42:12 user nova-compute[75006]: STATIC:
Nov 27 03:42:12 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:42:12 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:42:12 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:42:12 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a
Nov 27 03:42:12 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:42:12 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:42:12 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba
Nov 27 03:42:12 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:42:12 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:42:12 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:42:12 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:42:12 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:42:12 user nova-compute[75006]: FIRMWARE:
Nov 27 03:42:12 user nova-compute[75006]: No targets found.
Nov 27 03:42:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:42:12 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:42:12 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1044bfd8-856e-4c53-a44e-57033ef81a98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[84534380-66aa-4ba6-a480-3df346a50da2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:42:12 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:42:12 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:42:12 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:42:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:42:12 user nova-compute[75006]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba (non-flash)
Nov 27 03:42:12 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:42:12 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:42:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd424171ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53d36be-dff2-4f7f-a657-42f620afbf80]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c286116-70d2-4427-8ca5-d45e3e154d92]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246bda2-77a1-424d-94f8-057e3e740763]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:42:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3afd08-b8ef-4eef-8579-07448c6c8d03]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1f5fb9a7-281b9a9ade3e54c8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1f5fb9a7', '/dev/disk/by-id/scsi-23238316239613961') {{(pid=85775) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 03:42:13 user nova-compute[75006]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO1f5fb9a7-281b9a9ade3e54c8
Nov 27 03:42:13 user nova-compute[75006]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_1f5fb9a7
Nov 27 03:42:13 user nova-compute[75006]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23238316239613961
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5cdf71-fc7f-4e85-a943-10bca0bc2756]: (4, None) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf8eb01-bcf7-4f36-ba59-3e05f27d2e1e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ef77b1-29bf-44f0-bd46-5fe5de34c9e9]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba, portal: 172.16.0.220,3260]
Nov 27 03:42:13 user nova-compute[75006]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba, portal: 172.16.0.220,3260] successful.
Nov 27 03:42:13 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31cb72e8-aee3-4768-abf3-2c010176a4ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3e454-a098-4e13-b1f2-3f39c633020d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] <== disconnect_volume: return (399ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:42:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Deleting instance files /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442_del
Nov 27 03:42:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Deletion of /opt/stack/data/nova/instances/6ae5f39a-0c6d-4538-b358-1eb6c753f442_del complete
Nov 27 03:42:13 user nova-compute[75006]: INFO nova.compute.manager [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 27 03:42:13 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:42:13 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:42:13 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Took 0.53 seconds to deallocate network for instance.
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:14 user nova-compute[75006]: WARNING nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state resize_finish.
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-unplugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Acquiring lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] No waiting events found dispatching network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:14 user nova-compute[75006]: WARNING nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received unexpected event network-vif-plugged-5c7595e4-d17a-4894-be14-84875dd85457 for instance with vm_state active and task_state deleting.
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-0490e9d7-5ab1-4584-bc07-494419cbc17b req-14ad87fc-136b-4446-9e6d-cd1c14f3b802 service nova] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Received event network-vif-deleted-5c7595e4-d17a-4894-be14-84875dd85457 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:42:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance running successfully.
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Failed to set time: agent not configured {{(pid=75006) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 27 03:42:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-407860ea-dfe1-40be-a8ec-7280e75ea3b9 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] finish_migration finished successfully. {{(pid=75006) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 27 03:42:15 user nova-compute[75006]: INFO nova.compute.manager [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 6ae5f39a-0c6d-4538-b358-1eb6c753f442] Took 1.26 seconds to detach 1 volumes for instance.
Nov 27 03:42:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:15 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:42:15 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:42:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:15 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Deleted allocations for instance 6ae5f39a-0c6d-4538-b358-1eb6c753f442
Nov 27 03:42:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1e87c5e9-6204-4103-8eef-064160114e8f tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "6ae5f39a-0c6d-4538-b358-1eb6c753f442" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.674s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:17 user nova-compute[75006]: INFO nova.compute.manager [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Terminating instance
Nov 27 03:42:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-7a69d739-dab5-412f-912a-fbfd71c90a2f req-4eb0e351-26f2-42dc-806d-524b8b3d59b5 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received event network-vif-unplugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7a69d739-dab5-412f-912a-fbfd71c90a2f req-4eb0e351-26f2-42dc-806d-524b8b3d59b5 service nova] Acquiring lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7a69d739-dab5-412f-912a-fbfd71c90a2f req-4eb0e351-26f2-42dc-806d-524b8b3d59b5 service nova] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7a69d739-dab5-412f-912a-fbfd71c90a2f req-4eb0e351-26f2-42dc-806d-524b8b3d59b5 service nova] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-7a69d739-dab5-412f-912a-fbfd71c90a2f req-4eb0e351-26f2-42dc-806d-524b8b3d59b5 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] No waiting events found dispatching network-vif-unplugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-7a69d739-dab5-412f-912a-fbfd71c90a2f req-4eb0e351-26f2-42dc-806d-524b8b3d59b5 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received event network-vif-unplugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:42:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:18 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Instance destroyed successfully.
Nov 27 03:42:18 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'resources' on Instance uuid 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:37:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1369048475',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1369048475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1369048475',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbTOjDJ5EVtbIZar5KCvTnfcDIf0qaHR3xmyZKacwXRpGk3LJKSKOHW1gkCzh3q4CKyQMDTBObzHHDzIhN6f0PDyWSD7HAREE47Q5xrCVv1xpE4aiMdKxwmMqsXYlE9Fg==',key_name='tempest-keypair-1622692034',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:37:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-9nxlm3h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:37:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=84bc03ca-6487-4dcd-b16d-816eb3b3a3ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "address": "fa:16:3e:e4:b9:76", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cf0a9-82", "ovs_interfaceid": "007cf0a9-821e-4da0-99b6-6b4f7ced9c83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b9:76,bridge_name='br-int',has_traffic_filtering=True,id=007cf0a9-821e-4da0-99b6-6b4f7ced9c83,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cf0a9-82') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_vif [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b9:76,bridge_name='br-int',has_traffic_filtering=True,id=007cf0a9-821e-4da0-99b6-6b4f7ced9c83,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cf0a9-82') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007cf0a9-82, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9e48321-badc-4bc4-a8ad-f9e11087d17c) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:18 user nova-compute[75006]: INFO os_vif [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:b9:76,bridge_name='br-int',has_traffic_filtering=True,id=007cf0a9-821e-4da0-99b6-6b4f7ced9c83,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cf0a9-82')
Nov 27 03:42:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jhzmJLCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:42:18 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a5d54-c063-4139-9abc-586d7a1473bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:42:18 user nova-compute[75006]: No targets found.
Nov 27 03:42:18 user nova-compute[75006]: iSNS:
Nov 27 03:42:18 user nova-compute[75006]: No targets found.
Nov 27 03:42:18 user nova-compute[75006]: STATIC:
Nov 27 03:42:18 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:42:18 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:42:18 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:42:18 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a
Nov 27 03:42:18 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:42:18 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:42:18 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:42:18 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:42:18 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:42:18 user nova-compute[75006]: FIRMWARE:
Nov 27 03:42:18 user nova-compute[75006]: No targets found.
Nov 27 03:42:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:42:18 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:42:18 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1b54a7-15b9-41e7-b86a-da25f6358ca7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2faa08e-5682-454f-8781-09eb78b09752]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:42:18 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:42:18 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:42:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:42:18 user nova-compute[75006]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a (non-flash)
Nov 27 03:42:18 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:42:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c243d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f24fad-7f00-4f92-9460-1639348d0ffd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacec944-b019-4adb-8c31-64466bc7d6d2]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e134950-d8ca-4cc4-9dab-3e76e2eea445]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d1eab-4ec8-408c-bdc9-10e1076cac82]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO26a4ec2d-a123973befe8d300', '/dev/disk/by-id/scsi-26131323339373362', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_26a4ec2d') {{(pid=85775) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 03:42:18 user nova-compute[75006]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO26a4ec2d-a123973befe8d300
Nov 27 03:42:18 user nova-compute[75006]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26131323339373362
Nov 27 03:42:18 user nova-compute[75006]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_26a4ec2d
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d31c79d-230b-485b-9410-66050ad3b8b3]: (4, None) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a0172-31cd-49f6-9a69-0fd7638f948c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b10c8-4947-4aa5-be14-c32df7212bad]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a, portal: 172.16.0.220,3260]
Nov 27 03:42:18 user nova-compute[75006]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a, portal: 172.16.0.220,3260] successful.
Nov 27 03:42:18 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379896da-5199-47cc-a10f-76591d46132a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b210f071-9897-4e51-bbea-4dbb44fe6ab5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== disconnect_volume: return (325ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:42:18 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Deleting instance files /opt/stack/data/nova/instances/84bc03ca-6487-4dcd-b16d-816eb3b3a3ba_del
Nov 27 03:42:18 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Deletion of /opt/stack/data/nova/instances/84bc03ca-6487-4dcd-b16d-816eb3b3a3ba_del complete
Nov 27 03:42:18 user nova-compute[75006]: INFO nova.compute.manager [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 27 03:42:18 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:42:18 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:42:19 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:42:19 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Took 0.96 seconds to deallocate network for instance.
Nov 27 03:42:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-9ff42711-cd12-4698-9559-8274763eb093 req-2b7eeb61-a34e-4a13-a6b8-ba9d16242968 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received event network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9ff42711-cd12-4698-9559-8274763eb093 req-2b7eeb61-a34e-4a13-a6b8-ba9d16242968 service nova] Acquiring lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9ff42711-cd12-4698-9559-8274763eb093 req-2b7eeb61-a34e-4a13-a6b8-ba9d16242968 service nova] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9ff42711-cd12-4698-9559-8274763eb093 req-2b7eeb61-a34e-4a13-a6b8-ba9d16242968 service nova] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-9ff42711-cd12-4698-9559-8274763eb093 req-2b7eeb61-a34e-4a13-a6b8-ba9d16242968 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] No waiting events found dispatching network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:19 user nova-compute[75006]: WARNING nova.compute.manager [req-9ff42711-cd12-4698-9559-8274763eb093 req-2b7eeb61-a34e-4a13-a6b8-ba9d16242968 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received unexpected event network-vif-plugged-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 for instance with vm_state active and task_state deleting.
Nov 27 03:42:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-9ff42711-cd12-4698-9559-8274763eb093 req-2b7eeb61-a34e-4a13-a6b8-ba9d16242968 service nova] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Received event network-vif-deleted-007cf0a9-821e-4da0-99b6-6b4f7ced9c83 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:20 user nova-compute[75006]: INFO nova.compute.manager [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Took 0.75 seconds to detach 1 volumes for instance.
Nov 27 03:42:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba] Deleting volume: 379896da-5199-47cc-a10f-76591d46132a {{(pid=75006) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 03:42:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:20 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:42:20 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:42:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:20 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Deleted allocations for instance 84bc03ca-6487-4dcd-b16d-816eb3b3a3ba
Nov 27 03:42:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0dd67862-308a-4d49-b0f4-8a29783cd70f tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "84bc03ca-6487-4dcd-b16d-816eb3b3a3ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.693s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "64353d25-011c-46d5-955b-9da38d13587d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "64353d25-011c-46d5-955b-9da38d13587d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "64353d25-011c-46d5-955b-9da38d13587d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:28 user nova-compute[75006]: INFO nova.compute.manager [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Terminating instance
Nov 27 03:42:28 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-f6dfc6d7-f20a-4acf-a0fe-f902fd71e0b1 req-67deae1e-14d3-4abe-b77f-c42dde7f1c48 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received event network-vif-unplugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f6dfc6d7-f20a-4acf-a0fe-f902fd71e0b1 req-67deae1e-14d3-4abe-b77f-c42dde7f1c48 service nova] Acquiring lock "64353d25-011c-46d5-955b-9da38d13587d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f6dfc6d7-f20a-4acf-a0fe-f902fd71e0b1 req-67deae1e-14d3-4abe-b77f-c42dde7f1c48 service nova] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f6dfc6d7-f20a-4acf-a0fe-f902fd71e0b1 req-67deae1e-14d3-4abe-b77f-c42dde7f1c48 service nova] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-f6dfc6d7-f20a-4acf-a0fe-f902fd71e0b1 req-67deae1e-14d3-4abe-b77f-c42dde7f1c48 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] No waiting events found dispatching network-vif-unplugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-f6dfc6d7-f20a-4acf-a0fe-f902fd71e0b1 req-67deae1e-14d3-4abe-b77f-c42dde7f1c48 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received event network-vif-unplugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:42:29 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Instance destroyed successfully.
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.objects.instance [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lazy-loading 'resources' on Instance uuid 64353d25-011c-46d5-955b-9da38d13587d {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1545251799',display_name='tempest-VolumesNegativeTest-instance-1545251799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1545251799',id=46,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53329447e46e476591953013fb8182a2',ramdisk_id='',reservation_id='r-dkqf5pc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-126857204',owner_user_name='tempest-VolumesNegativeTest-126857204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:40:45Z,user_data=None,user_id='d22e79cc003141f6a9c6a414d2efb24c',uuid=64353d25-011c-46d5-955b-9da38d13587d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Converting VIF {"id": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "address": "fa:16:3e:3c:10:87", "network": {"id": "52f14334-9e5c-4e8b-ba6b-a94840627db1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "dcfabeafce3d4317a5394e7ee6c3ec8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9ba2a8-b3", "ovs_interfaceid": "db9ba2a8-b3c6-49a3-b615-e9766e1f988f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:10:87,bridge_name='br-int',has_traffic_filtering=True,id=db9ba2a8-b3c6-49a3-b615-e9766e1f988f,network=Network(52f14334-9e5c-4e8b-ba6b-a94840627db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9ba2a8-b3') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG os_vif [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:10:87,bridge_name='br-int',has_traffic_filtering=True,id=db9ba2a8-b3c6-49a3-b615-e9766e1f988f,network=Network(52f14334-9e5c-4e8b-ba6b-a94840627db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9ba2a8-b3') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb9ba2a8-b3, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=597d2ff8-da30-4587-ac51-cce334925c4a) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:29 user nova-compute[75006]: INFO os_vif [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:10:87,bridge_name='br-int',has_traffic_filtering=True,id=db9ba2a8-b3c6-49a3-b615-e9766e1f988f,network=Network(52f14334-9e5c-4e8b-ba6b-a94840627db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9ba2a8-b3')
Nov 27 03:42:29 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Deleting instance files /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d_del
Nov 27 03:42:29 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Deletion of /opt/stack/data/nova/instances/64353d25-011c-46d5-955b-9da38d13587d_del complete
Nov 27 03:42:29 user nova-compute[75006]: INFO nova.compute.manager [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 27 03:42:29 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:42:29 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 64353d25-011c-46d5-955b-9da38d13587d] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:42:30 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:42:30 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Took 0.56 seconds to deallocate network for instance.
Nov 27 03:42:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-30e4b0d0-7881-4928-9376-95c314c532d3 req-4a39218a-4975-49d5-aab6-375b0452ced6 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received event network-vif-deleted-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:30 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:42:30 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:42:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:30 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Deleted allocations for instance 64353d25-011c-46d5-955b-9da38d13587d
Nov 27 03:42:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ef82a84b-e4cb-4d82-8e70-be364ee7007b tempest-VolumesNegativeTest-126857204 tempest-VolumesNegativeTest-126857204-project-member] Lock "64353d25-011c-46d5-955b-9da38d13587d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-f2a18903-49db-4b2b-a732-84f79805caa7 req-cb40cee3-6f3b-4525-affd-ef1eafb46251 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received event network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f2a18903-49db-4b2b-a732-84f79805caa7 req-cb40cee3-6f3b-4525-affd-ef1eafb46251 service nova] Acquiring lock "64353d25-011c-46d5-955b-9da38d13587d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f2a18903-49db-4b2b-a732-84f79805caa7 req-cb40cee3-6f3b-4525-affd-ef1eafb46251 service nova] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f2a18903-49db-4b2b-a732-84f79805caa7 req-cb40cee3-6f3b-4525-affd-ef1eafb46251 service nova] Lock "64353d25-011c-46d5-955b-9da38d13587d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-f2a18903-49db-4b2b-a732-84f79805caa7 req-cb40cee3-6f3b-4525-affd-ef1eafb46251 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] No waiting events found dispatching network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:31 user nova-compute[75006]: WARNING nova.compute.manager [req-f2a18903-49db-4b2b-a732-84f79805caa7 req-cb40cee3-6f3b-4525-affd-ef1eafb46251 service nova] [instance: 64353d25-011c-46d5-955b-9da38d13587d] Received unexpected event network-vif-plugged-db9ba2a8-b3c6-49a3-b615-e9766e1f988f for instance with vm_state deleted and task_state None.
Nov 27 03:42:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:42:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:55 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:42:55 user nova-compute[75006]: INFO nova.compute.claims [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Claim successful on node user
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:42:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.policy [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09d37e9688a64fe8b60191b5243a1c20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eee74a64f09422ab25975e29d9d230a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:42:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Creating image(s)
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "/opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "/opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "/opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk 1073741824" returned: 0 in 0.097s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Successfully created port: 1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Cannot resize image /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Ensure instance console log exists: /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Successfully updated port: 1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquired lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-75e0b474-17b3-49a6-a9b0-6e438b335e1a req-ef5dba45-1e5c-4468-85be-887613f66fee service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-changed-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-75e0b474-17b3-49a6-a9b0-6e438b335e1a req-ef5dba45-1e5c-4468-85be-887613f66fee service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Refreshing instance network info cache due to event network-changed-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-75e0b474-17b3-49a6-a9b0-6e438b335e1a req-ef5dba45-1e5c-4468-85be-887613f66fee service nova] Acquiring lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:42:57 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating instance_info_cache with network_info: [{"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Releasing lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Instance network_info: |[{"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-75e0b474-17b3-49a6-a9b0-6e438b335e1a req-ef5dba45-1e5c-4468-85be-887613f66fee service nova] Acquired lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-75e0b474-17b3-49a6-a9b0-6e438b335e1a req-ef5dba45-1e5c-4468-85be-887613f66fee service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Refreshing network info cache for port 1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Start _get_guest_xml network_info=[{"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:42:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:42:58 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:42:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1486231319',display_name='tempest-SnapshotDataIntegrityTests-server-1486231319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1486231319',id=47,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/I9haFcMLOgphf8l1taUWSQddxrAXoZky7h3SKv1kqeuQJMWW94Lnv+mXCe4W5ewy7hmcwQ5f1aGF1ezuSJjJz/6c3AAKi3FA2ZbG6Vd1jvByUh0pTWwcNtsaN03d3Fg==',key_name='tempest-keypair-596794712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee74a64f09422ab25975e29d9d230a',ramdisk_id='',reservation_id='r-64lql6ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-60723552',owner_user_name='tempest-SnapshotDataIntegrityTests-60723552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d37e9688a64fe8b60191b5243a1c20',uuid=c714a10b-bf0a-4817-986c-6a9474166aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Converting VIF {"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:60:82,bridge_name='br-int',has_traffic_filtering=True,id=1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb,network=Network(47f5e6c5-de61-44b8-a4d7-c24acda04de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7d4021-4b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'pci_devices' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:42:58 user nova-compute[75006]:   <uuid>c714a10b-bf0a-4817-986c-6a9474166aff</uuid>
Nov 27 03:42:58 user nova-compute[75006]:   <name>instance-0000002f</name>
Nov 27 03:42:58 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:42:58 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:42:58 user nova-compute[75006]:   <metadata>
Nov 27 03:42:58 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:42:58 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:42:58 user nova-compute[75006]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1486231319</nova:name>
Nov 27 03:42:58 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:42:58</nova:creationTime>
Nov 27 03:42:58 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:42:58 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:42:58 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:42:58 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:42:58 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:42:58 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:42:58 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:42:58 user nova-compute[75006]:       <nova:owner>
Nov 27 03:42:58 user nova-compute[75006]:         <nova:user uuid="09d37e9688a64fe8b60191b5243a1c20">tempest-SnapshotDataIntegrityTests-60723552-project-member</nova:user>
Nov 27 03:42:58 user nova-compute[75006]:         <nova:project uuid="9eee74a64f09422ab25975e29d9d230a">tempest-SnapshotDataIntegrityTests-60723552</nova:project>
Nov 27 03:42:58 user nova-compute[75006]:       </nova:owner>
Nov 27 03:42:58 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:42:58 user nova-compute[75006]:       <nova:ports>
Nov 27 03:42:58 user nova-compute[75006]:         <nova:port uuid="1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb">
Nov 27 03:42:58 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 03:42:58 user nova-compute[75006]:         </nova:port>
Nov 27 03:42:58 user nova-compute[75006]:       </nova:ports>
Nov 27 03:42:58 user nova-compute[75006]:     </nova:instance>
Nov 27 03:42:58 user nova-compute[75006]:   </metadata>
Nov 27 03:42:58 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:42:58 user nova-compute[75006]:     <system>
Nov 27 03:42:58 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:42:58 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:42:58 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:42:58 user nova-compute[75006]:       <entry name="serial">c714a10b-bf0a-4817-986c-6a9474166aff</entry>
Nov 27 03:42:58 user nova-compute[75006]:       <entry name="uuid">c714a10b-bf0a-4817-986c-6a9474166aff</entry>
Nov 27 03:42:58 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:42:58 user nova-compute[75006]:     </system>
Nov 27 03:42:58 user nova-compute[75006]:   </sysinfo>
Nov 27 03:42:58 user nova-compute[75006]:   <os>
Nov 27 03:42:58 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:42:58 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:42:58 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:42:58 user nova-compute[75006]:   </os>
Nov 27 03:42:58 user nova-compute[75006]:   <features>
Nov 27 03:42:58 user nova-compute[75006]:     <acpi/>
Nov 27 03:42:58 user nova-compute[75006]:     <apic/>
Nov 27 03:42:58 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:42:58 user nova-compute[75006]:   </features>
Nov 27 03:42:58 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:42:58 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:42:58 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:42:58 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:42:58 user nova-compute[75006]:   </clock>
Nov 27 03:42:58 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:42:58 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:42:58 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:42:58 user nova-compute[75006]:   </cpu>
Nov 27 03:42:58 user nova-compute[75006]:   <devices>
Nov 27 03:42:58 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:42:58 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:42:58 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk"/>
Nov 27 03:42:58 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:42:58 user nova-compute[75006]:     </disk>
Nov 27 03:42:58 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:42:58 user nova-compute[75006]:       <mac address="fa:16:3e:5a:60:82"/>
Nov 27 03:42:58 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:42:58 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:42:58 user nova-compute[75006]:       <target dev="tap1e7d4021-4b"/>
Nov 27 03:42:58 user nova-compute[75006]:     </interface>
Nov 27 03:42:58 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:42:58 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/console.log" append="off"/>
Nov 27 03:42:58 user nova-compute[75006]:     </serial>
Nov 27 03:42:58 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:42:58 user nova-compute[75006]:     <video>
Nov 27 03:42:58 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:42:58 user nova-compute[75006]:     </video>
Nov 27 03:42:58 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:42:58 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:42:58 user nova-compute[75006]:     </rng>
Nov 27 03:42:58 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:42:58 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:42:58 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:42:58 user nova-compute[75006]:     </memballoon>
Nov 27 03:42:58 user nova-compute[75006]:   </devices>
Nov 27 03:42:58 user nova-compute[75006]: </domain>
Nov 27 03:42:58 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:42:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1486231319',display_name='tempest-SnapshotDataIntegrityTests-server-1486231319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1486231319',id=47,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/I9haFcMLOgphf8l1taUWSQddxrAXoZky7h3SKv1kqeuQJMWW94Lnv+mXCe4W5ewy7hmcwQ5f1aGF1ezuSJjJz/6c3AAKi3FA2ZbG6Vd1jvByUh0pTWwcNtsaN03d3Fg==',key_name='tempest-keypair-596794712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eee74a64f09422ab25975e29d9d230a',ramdisk_id='',reservation_id='r-64lql6ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-60723552',owner_user_name='tempest-SnapshotDataIntegrityTests-60723552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d37e9688a64fe8b60191b5243a1c20',uuid=c714a10b-bf0a-4817-986c-6a9474166aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Converting VIF {"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:60:82,bridge_name='br-int',has_traffic_filtering=True,id=1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb,network=Network(47f5e6c5-de61-44b8-a4d7-c24acda04de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7d4021-4b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG os_vif [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:60:82,bridge_name='br-int',has_traffic_filtering=True,id=1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb,network=Network(47f5e6c5-de61-44b8-a4d7-c24acda04de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7d4021-4b') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5baaedbd-a39f-5a81-82bf-9c196634c336', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e7d4021-4b, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e7d4021-4b, col_values=(('qos', UUID('f8143747-dfb4-4745-a11b-b8a3c8ebc361')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e7d4021-4b, col_values=(('external_ids', {'iface-id': '1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:60:82', 'vm-uuid': 'c714a10b-bf0a-4817-986c-6a9474166aff'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:58 user nova-compute[75006]: INFO os_vif [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:60:82,bridge_name='br-int',has_traffic_filtering=True,id=1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb,network=Network(47f5e6c5-de61-44b8-a4d7-c24acda04de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7d4021-4b')
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No VIF found with MAC fa:16:3e:5a:60:82, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-75e0b474-17b3-49a6-a9b0-6e438b335e1a req-ef5dba45-1e5c-4468-85be-887613f66fee service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updated VIF entry in instance network info cache for port 1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG nova.network.neutron [req-75e0b474-17b3-49a6-a9b0-6e438b335e1a req-ef5dba45-1e5c-4468-85be-887613f66fee service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating instance_info_cache with network_info: [{"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:42:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-75e0b474-17b3-49a6-a9b0-6e438b335e1a req-ef5dba45-1e5c-4468-85be-887613f66fee service nova] Releasing lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-1bfcd4df-63a6-48b6-94d6-3501ecfb8f42 req-f79bc520-a588-4eea-8233-9b07d9f6784b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1bfcd4df-63a6-48b6-94d6-3501ecfb8f42 req-f79bc520-a588-4eea-8233-9b07d9f6784b service nova] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1bfcd4df-63a6-48b6-94d6-3501ecfb8f42 req-f79bc520-a588-4eea-8233-9b07d9f6784b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1bfcd4df-63a6-48b6-94d6-3501ecfb8f42 req-f79bc520-a588-4eea-8233-9b07d9f6784b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:42:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-1bfcd4df-63a6-48b6-94d6-3501ecfb8f42 req-f79bc520-a588-4eea-8233-9b07d9f6784b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] No waiting events found dispatching network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:42:59 user nova-compute[75006]: WARNING nova.compute.manager [req-1bfcd4df-63a6-48b6-94d6-3501ecfb8f42 req-f79bc520-a588-4eea-8233-9b07d9f6784b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received unexpected event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb for instance with vm_state building and task_state spawning.
Nov 27 03:43:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-9881cc58-97b6-4ed2-b629-fb0667f2301d req-7d3dc02a-1cc7-4324-8d3a-68e02734358c service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9881cc58-97b6-4ed2-b629-fb0667f2301d req-7d3dc02a-1cc7-4324-8d3a-68e02734358c service nova] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9881cc58-97b6-4ed2-b629-fb0667f2301d req-7d3dc02a-1cc7-4324-8d3a-68e02734358c service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9881cc58-97b6-4ed2-b629-fb0667f2301d req-7d3dc02a-1cc7-4324-8d3a-68e02734358c service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-9881cc58-97b6-4ed2-b629-fb0667f2301d req-7d3dc02a-1cc7-4324-8d3a-68e02734358c service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] No waiting events found dispatching network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:01 user nova-compute[75006]: WARNING nova.compute.manager [req-9881cc58-97b6-4ed2-b629-fb0667f2301d req-7d3dc02a-1cc7-4324-8d3a-68e02734358c service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received unexpected event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb for instance with vm_state building and task_state spawning.
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:43:01 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Instance spawned successfully.
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:01 user nova-compute[75006]: INFO nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 27 03:43:01 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:43:02 user nova-compute[75006]: INFO nova.compute.manager [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Took 6.21 seconds to build instance.
Nov 27 03:43:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e5155cc2-3ce6-454e-a6b4-6210b3682784 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.322s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "54e46dc7-4d71-4720-9906-270ab0c872e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:02 user nova-compute[75006]: INFO nova.compute.manager [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Terminating instance
Nov 27 03:43:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:43:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-c21f9dd7-012b-4a56-8b39-c2f10f866552 req-d5e3458a-44b2-4df5-b50f-38eec1805cd6 service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received event network-vif-unplugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c21f9dd7-012b-4a56-8b39-c2f10f866552 req-d5e3458a-44b2-4df5-b50f-38eec1805cd6 service nova] Acquiring lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c21f9dd7-012b-4a56-8b39-c2f10f866552 req-d5e3458a-44b2-4df5-b50f-38eec1805cd6 service nova] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c21f9dd7-012b-4a56-8b39-c2f10f866552 req-d5e3458a-44b2-4df5-b50f-38eec1805cd6 service nova] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-c21f9dd7-012b-4a56-8b39-c2f10f866552 req-d5e3458a-44b2-4df5-b50f-38eec1805cd6 service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] No waiting events found dispatching network-vif-unplugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-c21f9dd7-012b-4a56-8b39-c2f10f866552 req-d5e3458a-44b2-4df5-b50f-38eec1805cd6 service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received event network-vif-unplugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Instance destroyed successfully.
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.objects.instance [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'resources' on Instance uuid 54e46dc7-4d71-4720-9906-270ab0c872e7 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:33:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2138748162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2138748162',id=38,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:33:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-73orpp5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:35:38Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=54e46dc7-4d71-4720-9906-270ab0c872e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "address": "fa:16:3e:91:6b:26", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d706da3-1b", "ovs_interfaceid": "6d706da3-1b94-45ed-8c43-cc71c9fd5ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:6b:26,bridge_name='br-int',has_traffic_filtering=True,id=6d706da3-1b94-45ed-8c43-cc71c9fd5ff3,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d706da3-1b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG os_vif [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:6b:26,bridge_name='br-int',has_traffic_filtering=True,id=6d706da3-1b94-45ed-8c43-cc71c9fd5ff3,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d706da3-1b') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d706da3-1b, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=544f411b-9392-40e1-9dc4-b3db4c98fb0a) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:03 user nova-compute[75006]: INFO os_vif [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:6b:26,bridge_name='br-int',has_traffic_filtering=True,id=6d706da3-1b94-45ed-8c43-cc71c9fd5ff3,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d706da3-1b')
Nov 27 03:43:03 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Deleting instance files /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7_del
Nov 27 03:43:03 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Deletion of /opt/stack/data/nova/instances/54e46dc7-4d71-4720-9906-270ab0c872e7_del complete
Nov 27 03:43:03 user nova-compute[75006]: INFO nova.compute.manager [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 27 03:43:03 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:43:04 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Took 0.71 seconds to deallocate network for instance.
Nov 27 03:43:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-4119b6f6-bd57-4f78-b54d-eb031aa9055a req-e3e42df8-a4bb-47ba-8e04-4c408a4c662d service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received event network-vif-deleted-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:04 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Deleted allocations for instance 54e46dc7-4d71-4720-9906-270ab0c872e7
Nov 27 03:43:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-381d687c-e080-4026-8e96-fd023620d686 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.981s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:43:04 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-92d63f40-aec0-4f4f-9c79-8d893779d005 req-85423ca2-baff-41dd-923f-d22dcc3fbbab service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received event network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-92d63f40-aec0-4f4f-9c79-8d893779d005 req-85423ca2-baff-41dd-923f-d22dcc3fbbab service nova] Acquiring lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-92d63f40-aec0-4f4f-9c79-8d893779d005 req-85423ca2-baff-41dd-923f-d22dcc3fbbab service nova] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-92d63f40-aec0-4f4f-9c79-8d893779d005 req-85423ca2-baff-41dd-923f-d22dcc3fbbab service nova] Lock "54e46dc7-4d71-4720-9906-270ab0c872e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG nova.compute.manager [req-92d63f40-aec0-4f4f-9c79-8d893779d005 req-85423ca2-baff-41dd-923f-d22dcc3fbbab service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] No waiting events found dispatching network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:05 user nova-compute[75006]: WARNING nova.compute.manager [req-92d63f40-aec0-4f4f-9c79-8d893779d005 req-85423ca2-baff-41dd-923f-d22dcc3fbbab service nova] [instance: 54e46dc7-4d71-4720-9906-270ab0c872e7] Received unexpected event network-vif-plugged-6d706da3-1b94-45ed-8c43-cc71c9fd5ff3 for instance with vm_state deleted and task_state None.
Nov 27 03:43:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:43:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:06 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:07 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:43:07 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8446MB free_disk=25.099369049072266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Applying migration context for instance 21797e41-8096-4cad-bb21-e877b40115eb as it has an incoming, in-progress migration 1cba2def-fb80-4328-8aed-286af88a5ab7. Migration status is finished {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 03:43:07 user nova-compute[75006]: INFO nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating resource usage from migration 1cba2def-fb80-4328-8aed-286af88a5ab7
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 55bfa775-09a3-40d5-a361-8c88466bfeb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Migration 1cba2def-fb80-4328-8aed-286af88a5ab7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 21797e41-8096-4cad-bb21-e877b40115eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c714a10b-bf0a-4817-986c-6a9474166aff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:43:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:08 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:43:13 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:43:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "28223224-fe72-4cb3-9d58-83536593b462" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "28223224-fe72-4cb3-9d58-83536593b462" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:43:17 user nova-compute[75006]: INFO nova.compute.claims [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Claim successful on node user
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:43:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.policy [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee3d2a74e8748c1aa045cc93d4894e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b1b7443dc44f21ac89452277f326b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:43:17 user nova-compute[75006]: INFO nova.virt.block_device [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Booting with volume 371da475-1334-4a40-bab4-5cc71d4f95a6 at /dev/vda
Nov 27 03:43:17 user nova-compute[75006]: DEBUG os_brick.utils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4c0b6-136a-4efe-9769-933cf7689517]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a37951d-1411-4685-8a55-02e3f301f99b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5b19da-c867-46fd-8f7d-11cc333f3b6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[15989b14-7acf-4bed-888b-19ac670d1e5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:43:17 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:43:17 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e2c400-1129-47ba-8ba5-b9842f5ec01d]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG os_brick.utils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:43:17 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Updating existing volume attachment record: 8e9d4cf9-a2c7-4093-bb22-33ae5839d6b2 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Successfully created port: a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Successfully updated port: a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquired lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-3bfce4f5-c75e-41ba-b3ad-400405852554 req-9781313e-91d5-475a-8d93-d1f8f39d402d service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received event network-changed-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG nova.compute.manager [req-3bfce4f5-c75e-41ba-b3ad-400405852554 req-9781313e-91d5-475a-8d93-d1f8f39d402d service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Refreshing instance network info cache due to event network-changed-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3bfce4f5-c75e-41ba-b3ad-400405852554 req-9781313e-91d5-475a-8d93-d1f8f39d402d service nova] Acquiring lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:43:18 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:43:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Updating instance_info_cache with network_info: [{"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:43:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Releasing lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:43:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Instance network_info: |[{"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:43:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3bfce4f5-c75e-41ba-b3ad-400405852554 req-9781313e-91d5-475a-8d93-d1f8f39d402d service nova] Acquired lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:43:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-3bfce4f5-c75e-41ba-b3ad-400405852554 req-9781313e-91d5-475a-8d93-d1f8f39d402d service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Refreshing network info cache for port a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:43:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-3bfce4f5-c75e-41ba-b3ad-400405852554 req-9781313e-91d5-475a-8d93-d1f8f39d402d service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Updated VIF entry in instance network info cache for port a8bccb28-8ea4-4062-86f3-f50e5bcc73b3. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:43:19 user nova-compute[75006]: DEBUG nova.network.neutron [req-3bfce4f5-c75e-41ba-b3ad-400405852554 req-9781313e-91d5-475a-8d93-d1f8f39d402d service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Updating instance_info_cache with network_info: [{"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:43:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3bfce4f5-c75e-41ba-b3ad-400405852554 req-9781313e-91d5-475a-8d93-d1f8f39d402d service nova] Releasing lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:43:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:43:24 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Creating image(s)
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Ensure instance console log exists: /opt/stack/data/nova/instances/28223224-fe72-4cb3-9d58-83536593b462/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Start _get_guest_xml network_info=[{"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '8e9d4cf9-a2c7-4093-bb22-33ae5839d6b2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSuUiYxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28223224-fe72-4cb3-9d58-83536593b462', 'attached_at': '', 'detached_at': '', 'volume_id': '371da475-1334-4a40-bab4-5cc71d4f95a6', 'serial': '371da475-1334-4a40-bab4-5cc71d4f95a6'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:43:24 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:43:24 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSuUiYxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:43:24 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:43:24 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:43:24 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0706c8-4e9c-47c9-9a61-db1e6f07618c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:43:24 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f84cc0-8c2c-45d3-911a-958e4a1597d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6] added
Nov 27 03:43:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba33d198-3527-4767-8d56-d0e71dc1c063]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a12da73-c720-46db-8dd6-6e17a5956f89]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSuUiYxo {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSuUiYxo" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f1b748-090a-45c2-8fb8-74c97f27cfc3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSuUiYxo'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c668de65-ed0a-4d44-af23-c01708c0785b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdc5ef6-a543-442b-b8f2-3c1b765a3d1a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:43:24 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:43:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:43:24 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:43:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd52066-d367-4f98-a564-a07fa0cd03a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260]
Nov 27 03:43:24 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260] successful.
Nov 27 03:43:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966fb98-cbac-4b9c-803c-d8ba04b3b4f3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f26ce-b33d-4b0c-9f75-1b504ad7a352]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:43:24 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:43:24 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:43:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:43:24 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:43:24 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:43:24 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f45a8e-3dc9-4895-83c2-7d3fdf74475c]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:43:24 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSuUiYxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23563323661636363', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563323661636363', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1096466115',display_name='tempest-TestVolumeBootPattern-server-1096466115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1096466115',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-hsb6ttno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:43:18Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=28223224-fe72-4cb3-9d58-83536593b462,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=a8bccb28-8ea4-4062-86f3-f50e5bcc73b3,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bccb28-8e') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'pci_devices' on Instance uuid 28223224-fe72-4cb3-9d58-83536593b462 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:43:25 user nova-compute[75006]:   <uuid>28223224-fe72-4cb3-9d58-83536593b462</uuid>
Nov 27 03:43:25 user nova-compute[75006]:   <name>instance-00000030</name>
Nov 27 03:43:25 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:43:25 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:43:25 user nova-compute[75006]:   <metadata>
Nov 27 03:43:25 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:43:25 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:43:25 user nova-compute[75006]:       <nova:name>tempest-TestVolumeBootPattern-server-1096466115</nova:name>
Nov 27 03:43:25 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:43:24</nova:creationTime>
Nov 27 03:43:25 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:43:25 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:43:25 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:43:25 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:43:25 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:43:25 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:43:25 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:43:25 user nova-compute[75006]:       <nova:owner>
Nov 27 03:43:25 user nova-compute[75006]:         <nova:user uuid="bee3d2a74e8748c1aa045cc93d4894e5">tempest-TestVolumeBootPattern-1716945418-project-member</nova:user>
Nov 27 03:43:25 user nova-compute[75006]:         <nova:project uuid="46b1b7443dc44f21ac89452277f326b1">tempest-TestVolumeBootPattern-1716945418</nova:project>
Nov 27 03:43:25 user nova-compute[75006]:       </nova:owner>
Nov 27 03:43:25 user nova-compute[75006]:       <nova:ports>
Nov 27 03:43:25 user nova-compute[75006]:         <nova:port uuid="a8bccb28-8ea4-4062-86f3-f50e5bcc73b3">
Nov 27 03:43:25 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 27 03:43:25 user nova-compute[75006]:         </nova:port>
Nov 27 03:43:25 user nova-compute[75006]:       </nova:ports>
Nov 27 03:43:25 user nova-compute[75006]:     </nova:instance>
Nov 27 03:43:25 user nova-compute[75006]:   </metadata>
Nov 27 03:43:25 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:43:25 user nova-compute[75006]:     <system>
Nov 27 03:43:25 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:43:25 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:43:25 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:43:25 user nova-compute[75006]:       <entry name="serial">28223224-fe72-4cb3-9d58-83536593b462</entry>
Nov 27 03:43:25 user nova-compute[75006]:       <entry name="uuid">28223224-fe72-4cb3-9d58-83536593b462</entry>
Nov 27 03:43:25 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:43:25 user nova-compute[75006]:     </system>
Nov 27 03:43:25 user nova-compute[75006]:   </sysinfo>
Nov 27 03:43:25 user nova-compute[75006]:   <os>
Nov 27 03:43:25 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:43:25 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:43:25 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:43:25 user nova-compute[75006]:   </os>
Nov 27 03:43:25 user nova-compute[75006]:   <features>
Nov 27 03:43:25 user nova-compute[75006]:     <acpi/>
Nov 27 03:43:25 user nova-compute[75006]:     <apic/>
Nov 27 03:43:25 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:43:25 user nova-compute[75006]:   </features>
Nov 27 03:43:25 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:43:25 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:43:25 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:43:25 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:43:25 user nova-compute[75006]:   </clock>
Nov 27 03:43:25 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:43:25 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:43:25 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:43:25 user nova-compute[75006]:   </cpu>
Nov 27 03:43:25 user nova-compute[75006]:   <devices>
Nov 27 03:43:25 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:43:25 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:43:25 user nova-compute[75006]:       <source dev="/dev/sdb"/>
Nov 27 03:43:25 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:43:25 user nova-compute[75006]:       <serial>371da475-1334-4a40-bab4-5cc71d4f95a6</serial>
Nov 27 03:43:25 user nova-compute[75006]:     </disk>
Nov 27 03:43:25 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:43:25 user nova-compute[75006]:       <mac address="fa:16:3e:17:5b:43"/>
Nov 27 03:43:25 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:43:25 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:43:25 user nova-compute[75006]:       <target dev="tapa8bccb28-8e"/>
Nov 27 03:43:25 user nova-compute[75006]:     </interface>
Nov 27 03:43:25 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:43:25 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/28223224-fe72-4cb3-9d58-83536593b462/console.log" append="off"/>
Nov 27 03:43:25 user nova-compute[75006]:     </serial>
Nov 27 03:43:25 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:43:25 user nova-compute[75006]:     <video>
Nov 27 03:43:25 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:43:25 user nova-compute[75006]:     </video>
Nov 27 03:43:25 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:43:25 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:43:25 user nova-compute[75006]:     </rng>
Nov 27 03:43:25 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:43:25 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:43:25 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:43:25 user nova-compute[75006]:     </memballoon>
Nov 27 03:43:25 user nova-compute[75006]:   </devices>
Nov 27 03:43:25 user nova-compute[75006]: </domain>
Nov 27 03:43:25 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1096466115',display_name='tempest-TestVolumeBootPattern-server-1096466115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1096466115',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-hsb6ttno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:43:18Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=28223224-fe72-4cb3-9d58-83536593b462,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=a8bccb28-8ea4-4062-86f3-f50e5bcc73b3,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bccb28-8e') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG os_vif [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=a8bccb28-8ea4-4062-86f3-f50e5bcc73b3,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bccb28-8e') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad395563-8b5e-5e1b-b68f-3e6dc25c2802', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8bccb28-8e, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8bccb28-8e, col_values=(('qos', UUID('99d409e1-caa7-4087-85c0-7cf53f2ed9fe')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8bccb28-8e, col_values=(('external_ids', {'iface-id': 'a8bccb28-8ea4-4062-86f3-f50e5bcc73b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:5b:43', 'vm-uuid': '28223224-fe72-4cb3-9d58-83536593b462'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:25 user nova-compute[75006]: INFO os_vif [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=a8bccb28-8ea4-4062-86f3-f50e5bcc73b3,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bccb28-8e')
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:43:25 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No VIF found with MAC fa:16:3e:17:5b:43, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG nova.compute.manager [req-736494b2-81fa-4004-b791-20c79e55f290 req-005f5e49-624d-47a5-8afe-843275e6b144 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received event network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-736494b2-81fa-4004-b791-20c79e55f290 req-005f5e49-624d-47a5-8afe-843275e6b144 service nova] Acquiring lock "28223224-fe72-4cb3-9d58-83536593b462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-736494b2-81fa-4004-b791-20c79e55f290 req-005f5e49-624d-47a5-8afe-843275e6b144 service nova] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-736494b2-81fa-4004-b791-20c79e55f290 req-005f5e49-624d-47a5-8afe-843275e6b144 service nova] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG nova.compute.manager [req-736494b2-81fa-4004-b791-20c79e55f290 req-005f5e49-624d-47a5-8afe-843275e6b144 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] No waiting events found dispatching network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:27 user nova-compute[75006]: WARNING nova.compute.manager [req-736494b2-81fa-4004-b791-20c79e55f290 req-005f5e49-624d-47a5-8afe-843275e6b144 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received unexpected event network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 for instance with vm_state building and task_state spawning.
Nov 27 03:43:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:43:29 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Instance spawned successfully.
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-2e098769-6cce-4e5a-9027-7a37b5513611 req-f061014f-d441-4359-a134-8d3daa5ced8e service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received event network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2e098769-6cce-4e5a-9027-7a37b5513611 req-f061014f-d441-4359-a134-8d3daa5ced8e service nova] Acquiring lock "28223224-fe72-4cb3-9d58-83536593b462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2e098769-6cce-4e5a-9027-7a37b5513611 req-f061014f-d441-4359-a134-8d3daa5ced8e service nova] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2e098769-6cce-4e5a-9027-7a37b5513611 req-f061014f-d441-4359-a134-8d3daa5ced8e service nova] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.compute.manager [req-2e098769-6cce-4e5a-9027-7a37b5513611 req-f061014f-d441-4359-a134-8d3daa5ced8e service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] No waiting events found dispatching network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:29 user nova-compute[75006]: WARNING nova.compute.manager [req-2e098769-6cce-4e5a-9027-7a37b5513611 req-f061014f-d441-4359-a134-8d3daa5ced8e service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received unexpected event network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 for instance with vm_state building and task_state spawning.
Nov 27 03:43:29 user nova-compute[75006]: INFO nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 27 03:43:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:43:29 user nova-compute[75006]: INFO nova.compute.manager [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Took 12.37 seconds to build instance.
Nov 27 03:43:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b304c07e-32cc-412c-8923-9569925d01b3 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "28223224-fe72-4cb3-9d58-83536593b462" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.471s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Going to confirm migration 2 {{(pid=75006) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:43:44 user nova-compute[75006]: INFO nova.compute.claims [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Claim successful on node user
Nov 27 03:43:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquired lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'info_cache' on Instance uuid 21797e41-8096-4cad-bb21-e877b40115eb {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:43:44 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.network.neutron [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:43:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.policy [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3aa8e6a955544d2a360cc6c757d9768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547df17332884139955057bf12619e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:43:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Creating image(s)
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "/opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "/opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "9b274f3c5e2f5ed45281098995d9104386ee2fbd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "9b274f3c5e2f5ed45281098995d9104386ee2fbd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.network.neutron [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Releasing lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'migration_context' on Instance uuid 21797e41-8096-4cad-bb21-e877b40115eb {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.objects.base [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Object Instance<21797e41-8096-4cad-bb21-e877b40115eb> lazy-loaded attributes: info_cache,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.virt.images [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:43:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd.part /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG nova.network.neutron [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Successfully created port: 35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd.part /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd.converted" returned: 0 in 0.471s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.757s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "9b274f3c5e2f5ed45281098995d9104386ee2fbd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.377s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:46 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Deleted allocation for migration 1cba2def-fb80-4328-8aed-286af88a5ab7
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd --force-share --output=json" returned: 0 in 0.194s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "9b274f3c5e2f5ed45281098995d9104386ee2fbd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "9b274f3c5e2f5ed45281098995d9104386ee2fbd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3a119cb6-ec3a-4d96-8476-85df06323964 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.320s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd --force-share --output=json" returned: 0 in 0.186s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd,backing_fmt=raw /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.neutron [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Successfully updated port: 35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd,backing_fmt=raw /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk 1073741824" returned: 0 in 0.052s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "9b274f3c5e2f5ed45281098995d9104386ee2fbd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquired lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.neutron [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-014cb61c-1a1e-48bd-8a6d-79fdb1a3a3b5 req-7771134d-dc48-494f-8667-e2d699983bb9 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-014cb61c-1a1e-48bd-8a6d-79fdb1a3a3b5 req-7771134d-dc48-494f-8667-e2d699983bb9 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing instance network info cache due to event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-014cb61c-1a1e-48bd-8a6d-79fdb1a3a3b5 req-7771134d-dc48-494f-8667-e2d699983bb9 service nova] Acquiring lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.neutron [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Cannot resize image /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Ensure instance console log exists: /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.neutron [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Releasing lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Instance network_info: |[{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-014cb61c-1a1e-48bd-8a6d-79fdb1a3a3b5 req-7771134d-dc48-494f-8667-e2d699983bb9 service nova] Acquired lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.neutron [req-014cb61c-1a1e-48bd-8a6d-79fdb1a3a3b5 req-7771134d-dc48-494f-8667-e2d699983bb9 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Start _get_guest_xml network_info=[{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:43:42Z,direct_url=<?>,disk_format='qcow2',id=b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb,min_disk=0,min_ram=0,name='tempest-scenario-img--574095681',owner='547df17332884139955057bf12619e4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:43:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:43:47 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:43:47 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:43:42Z,direct_url=<?>,disk_format='qcow2',id=b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb,min_disk=0,min_ram=0,name='tempest-scenario-img--574095681',owner='547df17332884139955057bf12619e4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:43:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-828253563',display_name='tempest-TestMinimumBasicScenario-server-828253563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-828253563',id=49,image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlrjdH7fytl3Xmar+pijwVOFUpYZbaCcomOMdkgvKJP9pNIMsOuCpVrw60q0QosiHQ/33xAvTCX0LQhPZHfdanCcAEW/2vo8ts4iYhBus9H/2GXMUZ9ZNJn7q3WAHs42g==',key_name='tempest-TestMinimumBasicScenario-1574990255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-tbvahw6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:43:45Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=3fc62fa4-b1dc-4e19-8a94-46ce222cde28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.objects.instance [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:43:47 user nova-compute[75006]:   <uuid>3fc62fa4-b1dc-4e19-8a94-46ce222cde28</uuid>
Nov 27 03:43:47 user nova-compute[75006]:   <name>instance-00000031</name>
Nov 27 03:43:47 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:43:47 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:43:47 user nova-compute[75006]:   <metadata>
Nov 27 03:43:47 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:43:47 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:43:47 user nova-compute[75006]:       <nova:name>tempest-TestMinimumBasicScenario-server-828253563</nova:name>
Nov 27 03:43:47 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:43:47</nova:creationTime>
Nov 27 03:43:47 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:43:47 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:43:47 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:43:47 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:43:47 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:43:47 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:43:47 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:43:47 user nova-compute[75006]:       <nova:owner>
Nov 27 03:43:47 user nova-compute[75006]:         <nova:user uuid="e3aa8e6a955544d2a360cc6c757d9768">tempest-TestMinimumBasicScenario-1813903653-project-member</nova:user>
Nov 27 03:43:47 user nova-compute[75006]:         <nova:project uuid="547df17332884139955057bf12619e4d">tempest-TestMinimumBasicScenario-1813903653</nova:project>
Nov 27 03:43:47 user nova-compute[75006]:       </nova:owner>
Nov 27 03:43:47 user nova-compute[75006]:       <nova:root type="image" uuid="b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb"/>
Nov 27 03:43:47 user nova-compute[75006]:       <nova:ports>
Nov 27 03:43:47 user nova-compute[75006]:         <nova:port uuid="35dda302-74eb-4b3f-9cdb-55d82cdc4e16">
Nov 27 03:43:47 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 03:43:47 user nova-compute[75006]:         </nova:port>
Nov 27 03:43:47 user nova-compute[75006]:       </nova:ports>
Nov 27 03:43:47 user nova-compute[75006]:     </nova:instance>
Nov 27 03:43:47 user nova-compute[75006]:   </metadata>
Nov 27 03:43:47 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:43:47 user nova-compute[75006]:     <system>
Nov 27 03:43:47 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:43:47 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:43:47 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:43:47 user nova-compute[75006]:       <entry name="serial">3fc62fa4-b1dc-4e19-8a94-46ce222cde28</entry>
Nov 27 03:43:47 user nova-compute[75006]:       <entry name="uuid">3fc62fa4-b1dc-4e19-8a94-46ce222cde28</entry>
Nov 27 03:43:47 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:43:47 user nova-compute[75006]:     </system>
Nov 27 03:43:47 user nova-compute[75006]:   </sysinfo>
Nov 27 03:43:47 user nova-compute[75006]:   <os>
Nov 27 03:43:47 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:43:47 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:43:47 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:43:47 user nova-compute[75006]:   </os>
Nov 27 03:43:47 user nova-compute[75006]:   <features>
Nov 27 03:43:47 user nova-compute[75006]:     <acpi/>
Nov 27 03:43:47 user nova-compute[75006]:     <apic/>
Nov 27 03:43:47 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:43:47 user nova-compute[75006]:   </features>
Nov 27 03:43:47 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:43:47 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:43:47 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:43:47 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:43:47 user nova-compute[75006]:   </clock>
Nov 27 03:43:47 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:43:47 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:43:47 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:43:47 user nova-compute[75006]:   </cpu>
Nov 27 03:43:47 user nova-compute[75006]:   <devices>
Nov 27 03:43:47 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:43:47 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:43:47 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk"/>
Nov 27 03:43:47 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:43:47 user nova-compute[75006]:     </disk>
Nov 27 03:43:47 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:43:47 user nova-compute[75006]:       <mac address="fa:16:3e:87:fe:9d"/>
Nov 27 03:43:47 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:43:47 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:43:47 user nova-compute[75006]:       <target dev="tap35dda302-74"/>
Nov 27 03:43:47 user nova-compute[75006]:     </interface>
Nov 27 03:43:47 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:43:47 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/console.log" append="off"/>
Nov 27 03:43:47 user nova-compute[75006]:     </serial>
Nov 27 03:43:47 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:43:47 user nova-compute[75006]:     <video>
Nov 27 03:43:47 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:43:47 user nova-compute[75006]:     </video>
Nov 27 03:43:47 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:43:47 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:43:47 user nova-compute[75006]:     </rng>
Nov 27 03:43:47 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:43:47 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:43:47 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:43:47 user nova-compute[75006]:     </memballoon>
Nov 27 03:43:47 user nova-compute[75006]:   </devices>
Nov 27 03:43:47 user nova-compute[75006]: </domain>
Nov 27 03:43:47 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-828253563',display_name='tempest-TestMinimumBasicScenario-server-828253563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-828253563',id=49,image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlrjdH7fytl3Xmar+pijwVOFUpYZbaCcomOMdkgvKJP9pNIMsOuCpVrw60q0QosiHQ/33xAvTCX0LQhPZHfdanCcAEW/2vo8ts4iYhBus9H/2GXMUZ9ZNJn7q3WAHs42g==',key_name='tempest-TestMinimumBasicScenario-1574990255',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-tbvahw6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:43:45Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=3fc62fa4-b1dc-4e19-8a94-46ce222cde28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG os_vif [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5dbe356-98fb-5df5-8b90-34370332052a', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35dda302-74, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35dda302-74, col_values=(('qos', UUID('2153eeb0-3d0b-466b-afb7-f4bfd0a0a7a0')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35dda302-74, col_values=(('external_ids', {'iface-id': '35dda302-74eb-4b3f-9cdb-55d82cdc4e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:fe:9d', 'vm-uuid': '3fc62fa4-b1dc-4e19-8a94-46ce222cde28'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:47 user nova-compute[75006]: INFO os_vif [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74')
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No VIF found with MAC fa:16:3e:87:fe:9d, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.neutron [req-014cb61c-1a1e-48bd-8a6d-79fdb1a3a3b5 req-7771134d-dc48-494f-8667-e2d699983bb9 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updated VIF entry in instance network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG nova.network.neutron [req-014cb61c-1a1e-48bd-8a6d-79fdb1a3a3b5 req-7771134d-dc48-494f-8667-e2d699983bb9 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:43:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-014cb61c-1a1e-48bd-8a6d-79fdb1a3a3b5 req-7771134d-dc48-494f-8667-e2d699983bb9 service nova] Releasing lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:43:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-074c67c6-e8fc-444b-85fe-e52a13a484ad req-19ae0ee9-5eb2-4ba5-8d0c-e18587083654 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-074c67c6-e8fc-444b-85fe-e52a13a484ad req-19ae0ee9-5eb2-4ba5-8d0c-e18587083654 service nova] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-074c67c6-e8fc-444b-85fe-e52a13a484ad req-19ae0ee9-5eb2-4ba5-8d0c-e18587083654 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-074c67c6-e8fc-444b-85fe-e52a13a484ad req-19ae0ee9-5eb2-4ba5-8d0c-e18587083654 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-074c67c6-e8fc-444b-85fe-e52a13a484ad req-19ae0ee9-5eb2-4ba5-8d0c-e18587083654 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] No waiting events found dispatching network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:49 user nova-compute[75006]: WARNING nova.compute.manager [req-074c67c6-e8fc-444b-85fe-e52a13a484ad req-19ae0ee9-5eb2-4ba5-8d0c-e18587083654 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received unexpected event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 for instance with vm_state building and task_state spawning.
Nov 27 03:43:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:43:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Instance spawned successfully.
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:43:51 user nova-compute[75006]: INFO nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-bdd83e0e-f59e-4144-bb45-9f7b0c1209c9 req-0145e9b9-2405-4edf-8b8b-00a26e3f006a service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bdd83e0e-f59e-4144-bb45-9f7b0c1209c9 req-0145e9b9-2405-4edf-8b8b-00a26e3f006a service nova] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bdd83e0e-f59e-4144-bb45-9f7b0c1209c9 req-0145e9b9-2405-4edf-8b8b-00a26e3f006a service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-bdd83e0e-f59e-4144-bb45-9f7b0c1209c9 req-0145e9b9-2405-4edf-8b8b-00a26e3f006a service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-bdd83e0e-f59e-4144-bb45-9f7b0c1209c9 req-0145e9b9-2405-4edf-8b8b-00a26e3f006a service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] No waiting events found dispatching network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:51 user nova-compute[75006]: WARNING nova.compute.manager [req-bdd83e0e-f59e-4144-bb45-9f7b0c1209c9 req-0145e9b9-2405-4edf-8b8b-00a26e3f006a service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received unexpected event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 for instance with vm_state building and task_state spawning.
Nov 27 03:43:51 user nova-compute[75006]: INFO nova.compute.manager [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Took 6.60 seconds to build instance.
Nov 27 03:43:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-bacc0b14-f1d2-48a8-a0c0-a32bcabb2051 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.694s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:53 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:53 user nova-compute[75006]: INFO nova.compute.manager [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Terminating instance
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-5e523448-8ba7-409c-badb-42cbcd536c2f req-b66da550-8b18-40df-beb8-c7019b006598 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5e523448-8ba7-409c-badb-42cbcd536c2f req-b66da550-8b18-40df-beb8-c7019b006598 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5e523448-8ba7-409c-badb-42cbcd536c2f req-b66da550-8b18-40df-beb8-c7019b006598 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5e523448-8ba7-409c-badb-42cbcd536c2f req-b66da550-8b18-40df-beb8-c7019b006598 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-5e523448-8ba7-409c-badb-42cbcd536c2f req-b66da550-8b18-40df-beb8-c7019b006598 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-5e523448-8ba7-409c-badb-42cbcd536c2f req-b66da550-8b18-40df-beb8-c7019b006598 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-unplugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Instance destroyed successfully.
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.objects.instance [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'resources' on Instance uuid 55bfa775-09a3-40d5-a361-8c88466bfeb2 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:28:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2086826292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2086826292',id=28,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:30:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-eis90tv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:31:55Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=55bfa775-09a3-40d5-a361-8c88466bfeb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "address": "fa:16:3e:54:aa:0f", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d688103-30", "ovs_interfaceid": "4d688103-30d3-4ec5-a22b-25f45607dfa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:aa:0f,bridge_name='br-int',has_traffic_filtering=True,id=4d688103-30d3-4ec5-a22b-25f45607dfa8,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d688103-30') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_vif [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:aa:0f,bridge_name='br-int',has_traffic_filtering=True,id=4d688103-30d3-4ec5-a22b-25f45607dfa8,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d688103-30') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d688103-30, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed2ca614-920e-474a-ad78-de1ddbb970a1) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:54 user nova-compute[75006]: INFO os_vif [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:aa:0f,bridge_name='br-int',has_traffic_filtering=True,id=4d688103-30d3-4ec5-a22b-25f45607dfa8,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d688103-30')
Nov 27 03:43:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RcNGHyAe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:43:54 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3fb18f-68eb-49c4-a6bf-20c2fd32cb4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:43:54 user nova-compute[75006]: No targets found.
Nov 27 03:43:54 user nova-compute[75006]: iSNS:
Nov 27 03:43:54 user nova-compute[75006]: No targets found.
Nov 27 03:43:54 user nova-compute[75006]: STATIC:
Nov 27 03:43:54 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:43:54 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:43:54 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:43:54 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b
Nov 27 03:43:54 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:43:54 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:43:54 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:43:54 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:43:54 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:43:54 user nova-compute[75006]: FIRMWARE:
Nov 27 03:43:54 user nova-compute[75006]: No targets found.
Nov 27 03:43:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:43:54 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:43:54 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[806a6220-336a-4a34-9ad8-892be668a4c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5fe09-460f-4e7b-98e5-d9f0ead795d7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:43:54 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:43:54 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:43:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b (non-flash)
Nov 27 03:43:54 user nova-compute[75006]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:43:54 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:43:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4246a9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b'): ({'sdc'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Removing single pathed devices sdc {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b2d299-30e5-4c46-ada7-62a2866f06e1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d92c7-c706-4117-90a0-a58ebfe345f4]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Flushing IO for device /dev/sdc {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e4168-a098-43ef-b653-55e78b7e0007]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d35ef7-e02c-46d6-a7ef-192926a2ab13]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:43:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde9d76d-b0de-4b3d-911b-c9ee0f51b51b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[696153f9-8a21-4138-bc45-0f08c4adbea7]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b, portal: 172.16.0.220,3260]
Nov 27 03:43:55 user nova-compute[75006]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b, portal: 172.16.0.220,3260] successful.
Nov 27 03:43:55 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257d1601-7eb5-4be0-8c2c-561dd6c7935b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8611902a-7767-481f-9dd1-a461e171da26]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] <== disconnect_volume: return (301ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:43:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Deleting instance files /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2_del
Nov 27 03:43:55 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Deletion of /opt/stack/data/nova/instances/55bfa775-09a3-40d5-a361-8c88466bfeb2_del complete
Nov 27 03:43:55 user nova-compute[75006]: INFO nova.compute.manager [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 27 03:43:55 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:43:55 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:43:55 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Took 0.40 seconds to deallocate network for instance.
Nov 27 03:43:56 user nova-compute[75006]: INFO nova.compute.manager [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Took 0.82 seconds to detach 1 volumes for instance.
Nov 27 03:43:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-b0f9c118-696b-49a1-b6ad-039a94826e9a req-3d111727-745c-47e8-8fd5-fda5b08dfb57 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b0f9c118-696b-49a1-b6ad-039a94826e9a req-3d111727-745c-47e8-8fd5-fda5b08dfb57 service nova] Acquiring lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b0f9c118-696b-49a1-b6ad-039a94826e9a req-3d111727-745c-47e8-8fd5-fda5b08dfb57 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b0f9c118-696b-49a1-b6ad-039a94826e9a req-3d111727-745c-47e8-8fd5-fda5b08dfb57 service nova] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-b0f9c118-696b-49a1-b6ad-039a94826e9a req-3d111727-745c-47e8-8fd5-fda5b08dfb57 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] No waiting events found dispatching network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:43:56 user nova-compute[75006]: WARNING nova.compute.manager [req-b0f9c118-696b-49a1-b6ad-039a94826e9a req-3d111727-745c-47e8-8fd5-fda5b08dfb57 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received unexpected event network-vif-plugged-4d688103-30d3-4ec5-a22b-25f45607dfa8 for instance with vm_state active and task_state deleting.
Nov 27 03:43:56 user nova-compute[75006]: DEBUG nova.compute.manager [req-b0f9c118-696b-49a1-b6ad-039a94826e9a req-3d111727-745c-47e8-8fd5-fda5b08dfb57 service nova] [instance: 55bfa775-09a3-40d5-a361-8c88466bfeb2] Received event network-vif-deleted-4d688103-30d3-4ec5-a22b-25f45607dfa8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:43:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:56 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Deleted allocations for instance 55bfa775-09a3-40d5-a361-8c88466bfeb2
Nov 27 03:43:56 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-1d6db5b9-665e-4fd2-a2d9-9e52c4ad3118 tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "55bfa775-09a3-40d5-a361-8c88466bfeb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.921s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:43:59 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:43:59 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:43:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:00 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:04 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:04 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:44:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:44:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:44:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:44:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:44:05 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:44:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updating instance_info_cache with network_info: [{"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:44:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:44:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:44:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:07 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:44:07 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:44:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:44:09 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8127MB free_disk=24.97188949584961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 21797e41-8096-4cad-bb21-e877b40115eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c714a10b-bf0a-4817-986c-6a9474166aff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 28223224-fe72-4cb3-9d58-83536593b462 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:44:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:44:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:44:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 87c685b0-44b9-400b-b98a-2066988857f4 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 21797e41-8096-4cad-bb21-e877b40115eb {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 28223224-fe72-4cb3-9d58-83536593b462 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Triggering sync for uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "87c685b0-44b9-400b-b98a-2066988857f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "21797e41-8096-4cad-bb21-e877b40115eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "28223224-fe72-4cb3-9d58-83536593b462" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "28223224-fe72-4cb3-9d58-83536593b462" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "87c685b0-44b9-400b-b98a-2066988857f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "21797e41-8096-4cad-bb21-e877b40115eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "28223224-fe72-4cb3-9d58-83536593b462" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:44 user nova-compute[75006]: INFO nova.compute.manager [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Terminating instance
Nov 27 03:44:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-40995f2f-4d40-47a5-baed-6657b67d5420 req-25b67d7d-38b2-4a5d-8c74-f6fc0999c3d7 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received event network-vif-unplugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-40995f2f-4d40-47a5-baed-6657b67d5420 req-25b67d7d-38b2-4a5d-8c74-f6fc0999c3d7 service nova] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-40995f2f-4d40-47a5-baed-6657b67d5420 req-25b67d7d-38b2-4a5d-8c74-f6fc0999c3d7 service nova] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-40995f2f-4d40-47a5-baed-6657b67d5420 req-25b67d7d-38b2-4a5d-8c74-f6fc0999c3d7 service nova] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-40995f2f-4d40-47a5-baed-6657b67d5420 req-25b67d7d-38b2-4a5d-8c74-f6fc0999c3d7 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] No waiting events found dispatching network-vif-unplugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-40995f2f-4d40-47a5-baed-6657b67d5420 req-25b67d7d-38b2-4a5d-8c74-f6fc0999c3d7 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received event network-vif-unplugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Instance destroyed successfully.
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.objects.instance [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lazy-loading 'resources' on Instance uuid c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1602843479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1602843479',id=24,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:25:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='03bbdcea84574886bbea67eefc84dca0',ramdisk_id='',reservation_id='r-ssyqvaw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:27:06Z,user_data=None,user_id='7bdc7ee98a95432d96679fc697b7d61d',uuid=c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converting VIF {"id": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "address": "fa:16:3e:3e:85:18", "network": {"id": "a5000e76-59fd-4d11-88b9-aa9cb934a263", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1701791937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "03bbdcea84574886bbea67eefc84dca0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a181ab5-f5", "ovs_interfaceid": "2a181ab5-f536-4562-a7a0-fcb24fd36438", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:85:18,bridge_name='br-int',has_traffic_filtering=True,id=2a181ab5-f536-4562-a7a0-fcb24fd36438,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a181ab5-f5') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG os_vif [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:85:18,bridge_name='br-int',has_traffic_filtering=True,id=2a181ab5-f536-4562-a7a0-fcb24fd36438,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a181ab5-f5') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a181ab5-f5, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8818757-8d12-4f3a-8d29-2a341ba6df7d) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:44:45 user nova-compute[75006]: INFO os_vif [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:85:18,bridge_name='br-int',has_traffic_filtering=True,id=2a181ab5-f536-4562-a7a0-fcb24fd36438,network=Network(a5000e76-59fd-4d11-88b9-aa9cb934a263),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a181ab5-f5')
Nov 27 03:44:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Deleting instance files /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec_del
Nov 27 03:44:45 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Deletion of /opt/stack/data/nova/instances/c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec_del complete
Nov 27 03:44:45 user nova-compute[75006]: INFO nova.compute.manager [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 27 03:44:45 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:44:45 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:44:46 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:44:46 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Took 0.48 seconds to deallocate network for instance.
Nov 27 03:44:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-b96557b9-de56-4a2e-b0fe-92cbbaabf1cf req-1f4ecf99-7735-42a8-af32-6d420011c4a6 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received event network-vif-deleted-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:44:46 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:44:46 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:44:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:46 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Deleted allocations for instance c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec
Nov 27 03:44:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-63212c03-c82a-40f6-b9a6-cbcf9b9b5f1c tempest-ServerBootFromVolumeStableRescueTest-2135085811 tempest-ServerBootFromVolumeStableRescueTest-2135085811-project-member] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.751s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received event network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] Acquiring lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] Lock "c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] No waiting events found dispatching network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:44:47 user nova-compute[75006]: WARNING nova.compute.manager [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] [instance: c0d78ee0-e7c6-4c06-81ef-91c3d0dc04ec] Received unexpected event network-vif-plugged-2a181ab5-f536-4562-a7a0-fcb24fd36438 for instance with vm_state deleted and task_state None.
Nov 27 03:44:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-changed-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Refreshing instance network info cache due to event network-changed-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] Acquiring lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] Acquired lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG nova.network.neutron [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Refreshing network info cache for port 1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG nova.network.neutron [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updated VIF entry in instance network info cache for port 1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG nova.network.neutron [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating instance_info_cache with network_info: [{"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:44:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-96575e64-51cc-4f4f-9b38-baa045e2859c req-96c162af-7799-42c9-acf2-f5250e54bdc6 service nova] Releasing lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG nova.objects.instance [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:44:50 user nova-compute[75006]: INFO nova.compute.manager [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attaching volume cac2c2ac-7ffc-43cd-968c-c82757ae3b7d to /dev/vdb
Nov 27 03:44:50 user nova-compute[75006]: DEBUG os_brick.utils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddcc120-3cbd-42e7-b1a8-91d23c0909ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc1ea6-6f3d-4613-83b4-358bb7f2abd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8924e3-250a-4242-b4ae-0e83ffdc5d7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a54200a-233e-4807-b9b1-dcddb44f39eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:44:50 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:44:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a66490-3625-4465-b212-535bb221f6fc]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG os_brick.utils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating existing volume attachment record: 62a28f4d-7e0b-4d8e-89d6-70962aa5ece3 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:44:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYacLQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:44:56 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:44:56 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:44:56 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf721c-93c3-4957-b340-3c1b50d44482]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:44:56 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[39117685-fdcb-457a-80fc-c6cc5a92283a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d] added
Nov 27 03:44:56 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d96c2-2db5-4cab-9ee3-bba3137c3ea7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08cd2c0-ab7f-430b-84b0-cb3072359ecb]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnYacLQy {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pnYacLQy" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc699b9-ce68-492f-ae6b-ce5f5b76f256]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pnYacLQy'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54cead1-94f3-44da-aea3-0e9518bfe8ad]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0129be-3107-4e16-a7c7-cd72ae8ca0f5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:44:56 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:44:56 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:44:56 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:44:56 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:44:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bd379d-5a30-40f2-bc79-23d318b3c933]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d, portal: 172.16.0.220,3260]
Nov 27 03:44:57 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d, portal: 172.16.0.220,3260] successful.
Nov 27 03:44:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d090702-04ba-4175-bf20-2584c0cc58bc]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed9e34e-e892-4f3e-ad92-f53a65ee6913]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:44:57 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:44:57 user nova-compute[75006]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)
Nov 27 03:44:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:44:57 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:44:57 user nova-compute[75006]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)
Nov 27 03:44:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a30f60-a4a9-4cf2-bd75-45e9171e4dff]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:44:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYacLQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26265633132336635', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265633132336635', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG nova.objects.instance [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:44:58 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:44:58 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:44:58 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:44:58 user nova-compute[75006]:   <serial>cac2c2ac-7ffc-43cd-968c-c82757ae3b7d</serial>
Nov 27 03:44:58 user nova-compute[75006]: </disk>
Nov 27 03:44:58 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No VIF found with MAC fa:16:3e:5a:60:82, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:44:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fa2dd775-bec7-4b97-9e5a-0b52664fc523 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.242s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:01 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:05 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:45:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:45:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:45:05 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:45:06 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updating instance_info_cache with network_info: [{"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:45:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-87c685b0-44b9-400b-b98a-2066988857f4" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:45:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:45:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-fe7486d2-11a2-419a-bb30-046cc5c31795 req-e6f6d414-bbc5-46e5-a9a7-86af9328be24 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received event network-changed-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG nova.compute.manager [req-fe7486d2-11a2-419a-bb30-046cc5c31795 req-e6f6d414-bbc5-46e5-a9a7-86af9328be24 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Refreshing instance network info cache due to event network-changed-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe7486d2-11a2-419a-bb30-046cc5c31795 req-e6f6d414-bbc5-46e5-a9a7-86af9328be24 service nova] Acquiring lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe7486d2-11a2-419a-bb30-046cc5c31795 req-e6f6d414-bbc5-46e5-a9a7-86af9328be24 service nova] Acquired lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-fe7486d2-11a2-419a-bb30-046cc5c31795 req-e6f6d414-bbc5-46e5-a9a7-86af9328be24 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Refreshing network info cache for port a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-fe7486d2-11a2-419a-bb30-046cc5c31795 req-e6f6d414-bbc5-46e5-a9a7-86af9328be24 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Updated VIF entry in instance network info cache for port a8bccb28-8ea4-4062-86f3-f50e5bcc73b3. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG nova.network.neutron [req-fe7486d2-11a2-419a-bb30-046cc5c31795 req-e6f6d414-bbc5-46e5-a9a7-86af9328be24 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Updating instance_info_cache with network_info: [{"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-fe7486d2-11a2-419a-bb30-046cc5c31795 req-e6f6d414-bbc5-46e5-a9a7-86af9328be24 service nova] Releasing lock "refresh_cache-28223224-fe72-4cb3-9d58-83536593b462" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "28223224-fe72-4cb3-9d58-83536593b462" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "28223224-fe72-4cb3-9d58-83536593b462" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "28223224-fe72-4cb3-9d58-83536593b462-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:09 user nova-compute[75006]: INFO nova.compute.manager [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Terminating instance
Nov 27 03:45:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-d723967c-ac4b-437c-9a58-356f21a05f49 req-745b2edd-c7e0-4cb8-8098-165d28f1fc3e service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received event network-vif-unplugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d723967c-ac4b-437c-9a58-356f21a05f49 req-745b2edd-c7e0-4cb8-8098-165d28f1fc3e service nova] Acquiring lock "28223224-fe72-4cb3-9d58-83536593b462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d723967c-ac4b-437c-9a58-356f21a05f49 req-745b2edd-c7e0-4cb8-8098-165d28f1fc3e service nova] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d723967c-ac4b-437c-9a58-356f21a05f49 req-745b2edd-c7e0-4cb8-8098-165d28f1fc3e service nova] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-d723967c-ac4b-437c-9a58-356f21a05f49 req-745b2edd-c7e0-4cb8-8098-165d28f1fc3e service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] No waiting events found dispatching network-vif-unplugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.compute.manager [req-d723967c-ac4b-437c-9a58-356f21a05f49 req-745b2edd-c7e0-4cb8-8098-165d28f1fc3e service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received event network-vif-unplugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:45:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Instance destroyed successfully.
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'resources' on Instance uuid 28223224-fe72-4cb3-9d58-83536593b462 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1096466115',display_name='tempest-TestVolumeBootPattern-server-1096466115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1096466115',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-hsb6ttno',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:43:29Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=28223224-fe72-4cb3-9d58-83536593b462,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "address": "fa:16:3e:17:5b:43", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bccb28-8e", "ovs_interfaceid": "a8bccb28-8ea4-4062-86f3-f50e5bcc73b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=a8bccb28-8ea4-4062-86f3-f50e5bcc73b3,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bccb28-8e') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_vif [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=a8bccb28-8ea4-4062-86f3-f50e5bcc73b3,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bccb28-8e') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8bccb28-8e, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99d409e1-caa7-4087-85c0-7cf53f2ed9fe) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:45:10 user nova-compute[75006]: INFO os_vif [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:5b:43,bridge_name='br-int',has_traffic_filtering=True,id=a8bccb28-8ea4-4062-86f3-f50e5bcc73b3,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bccb28-8e')
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSuUiYxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:45:10 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b7c3b6-44c6-47b9-9f62-6ee96c245b3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:45:10 user nova-compute[75006]: No targets found.
Nov 27 03:45:10 user nova-compute[75006]: iSNS:
Nov 27 03:45:10 user nova-compute[75006]: No targets found.
Nov 27 03:45:10 user nova-compute[75006]: STATIC:
Nov 27 03:45:10 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:45:10 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:45:10 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:45:10 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d
Nov 27 03:45:10 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:45:10 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:45:10 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:45:10 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:45:10 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:45:10 user nova-compute[75006]: FIRMWARE:
Nov 27 03:45:10 user nova-compute[75006]: No targets found.
Nov 27 03:45:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:45:10 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:45:10 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f925f-e110-4bda-b807-dc6a8d05493c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e0f961-8e49-46aa-8f78-817c57d1edde]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:45:10 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:45:10 user nova-compute[75006]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)
Nov 27 03:45:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:45:10 user nova-compute[75006]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:45:10 user nova-compute[75006]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)
Nov 27 03:45:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd44516e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3da3bca-5439-4f2d-98a3-27681c233ca0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ee327e-ae38-4fbc-977b-1c0058c56a9b]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5874f8-825e-457e-9930-a13041ed00a9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6c6699-0da9-482c-9b76-db188e5ea911]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4ef6f991', '/dev/disk/by-id/scsi-1SCST_BIO4ef6f991-5c26acccd115c617', '/dev/disk/by-id/scsi-23563323661636363') {{(pid=85775) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 03:45:10 user nova-compute[75006]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23563323661636363
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1f5372-354b-48c9-a36d-ce909dd07383]: (4, None) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32f678-e9cb-4941-8338-61a3829b888b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f48e82a-7136-48f8-971b-faf3e5682610]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260]
Nov 27 03:45:10 user nova-compute[75006]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260] successful.
Nov 27 03:45:10 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08a307e-569b-4d9d-96b9-e22dfd8af0c6]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== disconnect_volume: return (411ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:45:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Deleting instance files /opt/stack/data/nova/instances/28223224-fe72-4cb3-9d58-83536593b462_del
Nov 27 03:45:10 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Deletion of /opt/stack/data/nova/instances/28223224-fe72-4cb3-9d58-83536593b462_del complete
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:10 user nova-compute[75006]: INFO nova.compute.manager [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 27 03:45:10 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:45:10 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 28223224-fe72-4cb3-9d58-83536593b462] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:45:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:11 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:45:11 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Error from libvirt while getting description of instance-00000030: [Error Code 42] Domain not found: no domain with matching uuid '28223224-fe72-4cb3-9d58-83536593b462' (instance-00000030): libvirt.libvirtError: Domain not found: no domain with matching uuid '28223224-fe72-4cb3-9d58-83536593b462' (instance-00000030)
Nov 27 03:45:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:11 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:12 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:45:12 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=25.09392547607422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-d4142c73-fc5a-4c71-a5af-70635114d5eb req-bf9161fe-d054-4436-b44e-4ebdc588a82c service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received event network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d4142c73-fc5a-4c71-a5af-70635114d5eb req-bf9161fe-d054-4436-b44e-4ebdc588a82c service nova] Acquiring lock "28223224-fe72-4cb3-9d58-83536593b462-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d4142c73-fc5a-4c71-a5af-70635114d5eb req-bf9161fe-d054-4436-b44e-4ebdc588a82c service nova] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d4142c73-fc5a-4c71-a5af-70635114d5eb req-bf9161fe-d054-4436-b44e-4ebdc588a82c service nova] Lock "28223224-fe72-4cb3-9d58-83536593b462-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-d4142c73-fc5a-4c71-a5af-70635114d5eb req-bf9161fe-d054-4436-b44e-4ebdc588a82c service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] No waiting events found dispatching network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:45:12 user nova-compute[75006]: WARNING nova.compute.manager [req-d4142c73-fc5a-4c71-a5af-70635114d5eb req-bf9161fe-d054-4436-b44e-4ebdc588a82c service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received unexpected event network-vif-plugged-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 for instance with vm_state active and task_state deleting.
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 21797e41-8096-4cad-bb21-e877b40115eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c714a10b-bf0a-4817-986c-6a9474166aff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 28223224-fe72-4cb3-9d58-83536593b462 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:45:12 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Took 1.20 seconds to deallocate network for instance.
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-f2d2c636-e154-451a-bb26-25a061c4d3b6 req-9e418570-2455-44ad-8386-e15a5b203914 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Received event network-vif-deleted-a8bccb28-8ea4-4062-86f3-f50e5bcc73b3 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:45:12 user nova-compute[75006]: INFO nova.compute.manager [req-f2d2c636-e154-451a-bb26-25a061c4d3b6 req-9e418570-2455-44ad-8386-e15a5b203914 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Neutron deleted interface a8bccb28-8ea4-4062-86f3-f50e5bcc73b3; detaching it from the instance and deleting it from the info cache
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.network.neutron [req-f2d2c636-e154-451a-bb26-25a061c4d3b6 req-9e418570-2455-44ad-8386-e15a5b203914 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-f2d2c636-e154-451a-bb26-25a061c4d3b6 req-9e418570-2455-44ad-8386-e15a5b203914 service nova] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Detach interface failed, port_id=a8bccb28-8ea4-4062-86f3-f50e5bcc73b3, reason: Instance 28223224-fe72-4cb3-9d58-83536593b462 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:12 user nova-compute[75006]: INFO nova.compute.manager [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Detaching volume cac2c2ac-7ffc-43cd-968c-c82757ae3b7d
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:45:12 user nova-compute[75006]: INFO nova.virt.block_device [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attempting to driver detach volume cac2c2ac-7ffc-43cd-968c-c82757ae3b7d from mountpoint /dev/vdb
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Attempting to detach device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:45:12 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:45:12 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:45:12 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:45:12 user nova-compute[75006]:   <serial>cac2c2ac-7ffc-43cd-968c-c82757ae3b7d</serial>
Nov 27 03:45:12 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:45:12 user nova-compute[75006]: </disk>
Nov 27 03:45:12 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:45:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully detached device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the persistent domain config.
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c714a10b-bf0a-4817-986c-6a9474166aff from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:45:12 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:45:12 user nova-compute[75006]:   <source dev="/dev/sdc"/>
Nov 27 03:45:12 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:45:12 user nova-compute[75006]:   <serial>cac2c2ac-7ffc-43cd-968c-c82757ae3b7d</serial>
Nov 27 03:45:12 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:45:12 user nova-compute[75006]: </disk>
Nov 27 03:45:12 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:45:12 user nova-compute[75006]: INFO nova.compute.manager [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 28223224-fe72-4cb3-9d58-83536593b462] Took 0.76 seconds to detach 1 volumes for instance.
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:13 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:45:13 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:45:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:13 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Deleted allocations for instance 28223224-fe72-4cb3-9d58-83536593b462
Nov 27 03:45:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-acb22d98-b502-42c4-979f-310a0cbae21e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "28223224-fe72-4cb3-9d58-83536593b462" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.678s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:45:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:45:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:32 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c714a10b-bf0a-4817-986c-6a9474166aff is timed out.
Nov 27 03:45:32 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully detached device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the live domain config.
Nov 27 03:45:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pnYacLQy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:45:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbe06ae-8119-44cb-976d-5c78cf6feb2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:45:32 user nova-compute[75006]: No targets found.
Nov 27 03:45:32 user nova-compute[75006]: iSNS:
Nov 27 03:45:32 user nova-compute[75006]: No targets found.
Nov 27 03:45:32 user nova-compute[75006]: STATIC:
Nov 27 03:45:32 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:45:32 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:45:32 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:45:32 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d
Nov 27 03:45:32 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:45:32 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:45:32 user nova-compute[75006]: FIRMWARE:
Nov 27 03:45:32 user nova-compute[75006]: No targets found.
Nov 27 03:45:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:45:32 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:45:32 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c4ff31-cdfb-41be-9655-8238e12c91fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b24fb8-c13e-4bda-887f-4a5a58e8a3ed]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:45:32 user nova-compute[75006]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)
Nov 27 03:45:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:45:32 user nova-compute[75006]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d (non-flash)
Nov 27 03:45:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d'): ({'sdc'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Removing single pathed devices sdc {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b70aaa-a5d8-4aac-ae66-7f2685c84fe4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9747f6-3b90-4484-ab65-da6a0f635c25]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Flushing IO for device /dev/sdc {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8c64b5-04d9-404c-aeb5-f3e5464be90a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:45:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e1dac-22cc-4c03-8049-50ad0c9c5e2a]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a47ba-3a62-42ae-b321-220f70fd51da]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91e1719-774b-4fb4-b9f8-b81d1a5f0f5d]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d, portal: 172.16.0.220,3260]
Nov 27 03:45:33 user nova-compute[75006]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d, portal: 172.16.0.220,3260] successful.
Nov 27 03:45:33 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac2c2ac-7ffc-43cd-968c-c82757ae3b7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd76d41-a0ec-4cb7-8cff-cfdfc1dec7d0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== disconnect_volume: return (318ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:45:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8bf1be27-33ba-44d2-9b87-d33f04236eb1 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.677s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:45:35 user nova-compute[75006]: INFO nova.compute.manager [None req-8779880e-d44c-4f91-8337-97d844246d60 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Get console output
Nov 27 03:45:35 user nova-compute[75006]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 27 03:45:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG nova.objects.instance [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'flavor' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:38 user nova-compute[75006]: INFO nova.compute.manager [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Attaching volume 64b45680-4d23-477d-b9e6-58fbc673e9a2 to /dev/vdb
Nov 27 03:45:38 user nova-compute[75006]: DEBUG os_brick.utils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b923f4f4-7caf-419d-b485-886010c08957]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff94d19-a256-4913-a962-31810b556c4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7c6ad1-311f-4603-b12e-82abfd777c42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[20aa75f0-99ee-4fdd-a6d8-761e2575c5ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:45:38 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:45:38 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf66474c-44fa-4858-9371-f06cda2da8a3]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG os_brick.utils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:45:38 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating existing volume attachment record: 4066a186-14d4-4228-9d21-15c49bb6a882 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:45:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLTUeBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:45:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:45:44 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:45:44 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa01bb1-696d-4b13-a85a-582622454420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:45:44 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4832e1-bde2-495b-b21c-33bff7e5c596]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2] added
Nov 27 03:45:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6912efa-d7d0-4729-bb60-38729c420f0b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd04a13-6dd6-44a4-8891-7f5c21300e9f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLTUeBFC {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLTUeBFC" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c60c739-e723-4e28-bf08-a102948e611d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bLTUeBFC'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[22392d73-3a24-49dd-acd6-231271483cc3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[771d3dfb-85bc-4eb6-bf06-b3cd082e5b16]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:45:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:45:44 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:45:44 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51adbdd-885e-4f5e-89d5-fe1aa96ac4a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260]
Nov 27 03:45:45 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260] successful.
Nov 27 03:45:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5dd3d5-849d-4731-a830-9636fdcaab0f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf1584f-a92d-484d-8941-95b120e8d2b4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:45:45 user nova-compute[75006]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:45:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:45:45 user nova-compute[75006]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:45:45 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f248824-a1f6-41c4-aeb4-fece8b24939f]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLTUeBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:45:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23731363564613530', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731363564613530', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG nova.objects.instance [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'flavor' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:45:46 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:45:46 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:45:46 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:45:46 user nova-compute[75006]:   <serial>64b45680-4d23-477d-b9e6-58fbc673e9a2</serial>
Nov 27 03:45:46 user nova-compute[75006]: </disk>
Nov 27 03:45:46 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No VIF found with MAC fa:16:3e:87:fe:9d, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:45:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4882ac58-db28-499c-b226-1fadc8ec06c7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.364s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:45:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-7bb85523-853c-4a2f-86d3-4bf82e5d115d req-f9a9fb87-d79f-4727-b0c7-07309a5572bc service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:45:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-7bb85523-853c-4a2f-86d3-4bf82e5d115d req-f9a9fb87-d79f-4727-b0c7-07309a5572bc service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing instance network info cache due to event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:45:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7bb85523-853c-4a2f-86d3-4bf82e5d115d req-f9a9fb87-d79f-4727-b0c7-07309a5572bc service nova] Acquiring lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:45:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7bb85523-853c-4a2f-86d3-4bf82e5d115d req-f9a9fb87-d79f-4727-b0c7-07309a5572bc service nova] Acquired lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:45:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-7bb85523-853c-4a2f-86d3-4bf82e5d115d req-f9a9fb87-d79f-4727-b0c7-07309a5572bc service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:45:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-7bb85523-853c-4a2f-86d3-4bf82e5d115d req-f9a9fb87-d79f-4727-b0c7-07309a5572bc service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updated VIF entry in instance network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:45:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-7bb85523-853c-4a2f-86d3-4bf82e5d115d req-f9a9fb87-d79f-4727-b0c7-07309a5572bc service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:45:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-7bb85523-853c-4a2f-86d3-4bf82e5d115d req-f9a9fb87-d79f-4727-b0c7-07309a5572bc service nova] Releasing lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:45:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-6c4e41df-551e-4ac9-8655-72fd3f8bc5a0 req-c9cefcb4-2250-4bd0-9662-6cdcbe6033f7 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:45:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-6c4e41df-551e-4ac9-8655-72fd3f8bc5a0 req-c9cefcb4-2250-4bd0-9662-6cdcbe6033f7 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing instance network info cache due to event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:45:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6c4e41df-551e-4ac9-8655-72fd3f8bc5a0 req-c9cefcb4-2250-4bd0-9662-6cdcbe6033f7 service nova] Acquiring lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:45:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6c4e41df-551e-4ac9-8655-72fd3f8bc5a0 req-c9cefcb4-2250-4bd0-9662-6cdcbe6033f7 service nova] Acquired lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:45:54 user nova-compute[75006]: DEBUG nova.network.neutron [req-6c4e41df-551e-4ac9-8655-72fd3f8bc5a0 req-c9cefcb4-2250-4bd0-9662-6cdcbe6033f7 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-6c4e41df-551e-4ac9-8655-72fd3f8bc5a0 req-c9cefcb4-2250-4bd0-9662-6cdcbe6033f7 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updated VIF entry in instance network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-6c4e41df-551e-4ac9-8655-72fd3f8bc5a0 req-c9cefcb4-2250-4bd0-9662-6cdcbe6033f7 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6c4e41df-551e-4ac9-8655-72fd3f8bc5a0 req-c9cefcb4-2250-4bd0-9662-6cdcbe6033f7 service nova] Releasing lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:58 user nova-compute[75006]: INFO nova.compute.manager [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Rebooting instance
Nov 27 03:45:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:45:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquired lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:45:58 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG nova.network.neutron [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Releasing lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-43b47d8f-3a4d-4156-8c24-d2313335bdca req-969cc1d2-468f-4453-a6b8-499bd097fc21 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-unplugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-43b47d8f-3a4d-4156-8c24-d2313335bdca req-969cc1d2-468f-4453-a6b8-499bd097fc21 service nova] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-43b47d8f-3a4d-4156-8c24-d2313335bdca req-969cc1d2-468f-4453-a6b8-499bd097fc21 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-43b47d8f-3a4d-4156-8c24-d2313335bdca req-969cc1d2-468f-4453-a6b8-499bd097fc21 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG nova.compute.manager [req-43b47d8f-3a4d-4156-8c24-d2313335bdca req-969cc1d2-468f-4453-a6b8-499bd097fc21 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] No waiting events found dispatching network-vif-unplugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:45:59 user nova-compute[75006]: WARNING nova.compute.manager [req-43b47d8f-3a4d-4156-8c24-d2313335bdca req-969cc1d2-468f-4453-a6b8-499bd097fc21 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received unexpected event network-vif-unplugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 for instance with vm_state active and task_state reboot_started_hard.
Nov 27 03:45:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Instance destroyed successfully.
Nov 27 03:45:59 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'resources' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-828253563',display_name='tempest-TestMinimumBasicScenario-server-828253563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-828253563',id=49,image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlrjdH7fytl3Xmar+pijwVOFUpYZbaCcomOMdkgvKJP9pNIMsOuCpVrw60q0QosiHQ/33xAvTCX0LQhPZHfdanCcAEW/2vo8ts4iYhBus9H/2GXMUZ9ZNJn7q3WAHs42g==',key_name='tempest-TestMinimumBasicScenario-1574990255',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-tbvahw6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:45:59Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=3fc62fa4-b1dc-4e19-8a94-46ce222cde28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG os_vif [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35dda302-74, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:45:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2153eeb0-3d0b-466b-afb7-f4bfd0a0a7a0) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:00 user nova-compute[75006]: INFO os_vif [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74')
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLTUeBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:46:00 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05580ac-66cd-49d2-9bf1-95ababdcc678]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:46:00 user nova-compute[75006]: No targets found.
Nov 27 03:46:00 user nova-compute[75006]: iSNS:
Nov 27 03:46:00 user nova-compute[75006]: No targets found.
Nov 27 03:46:00 user nova-compute[75006]: STATIC:
Nov 27 03:46:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:46:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2
Nov 27 03:46:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:00 user nova-compute[75006]: FIRMWARE:
Nov 27 03:46:00 user nova-compute[75006]: No targets found.
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:46:00 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:46:00 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d60cf3-51bd-4693-81c0-20e6d10da8d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[827d2b73-8391-4558-90dd-5de86c9507f8]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:00 user nova-compute[75006]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:00 user nova-compute[75006]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd42429e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d5bda2-84a5-43fd-bd58-15b90e01b257]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64ea57b-f13f-4df9-bde9-897ef0736e43]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81532c5-5eb0-4d74-b396-38354cddc85c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[689b910e-a132-4e1e-8835-04651575455f]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a81862-c738-4ccb-83e3-0c5db3b231b0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[546c82c9-52cd-4d6d-9182-f5987d684b92]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260]
Nov 27 03:46:00 user nova-compute[75006]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260] successful.
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[256bc2bb-d0bf-497b-bef0-ce087eb15584]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] <== disconnect_volume: return (302ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Start _get_guest_xml network_info=[{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '4066a186-14d4-4228-9d21-15c49bb6a882', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLTUeBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3fc62fa4-b1dc-4e19-8a94-46ce222cde28', 'attached_at': '', 'detached_at': '', 'volume_id': '64b45680-4d23-477d-b9e6-58fbc673e9a2', 'serial': '64b45680-4d23-477d-b9e6-58fbc673e9a2'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:46:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:46:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.objects.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Object Instance<3fc62fa4-b1dc-4e19-8a94-46ce222cde28> lazy-loaded attributes: resources,vcpu_model {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLTUeBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:46:00 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:00 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:00 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4cd21c-e3d2-49c4-a8ee-27b61b0ca2e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:46:00 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bbd211-e68e-4dc8-99b0-18ff16ec6386]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2] added
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[955908f3-fddb-449c-92b4-479780bce7cf]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0030a1c-3c20-4e44-8cef-25f44893c6d9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLTUeBFC {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLTUeBFC" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[665cc96a-3acf-45dc-9772-12ee34af0f5d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bLTUeBFC'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad07761-4f68-45ac-a996-818ca53de7b0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e380ad46-9337-46a9-8325-4914a1e20089]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626f40c-eba7-4956-a696-56d29cf6b9b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260]
Nov 27 03:46:00 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260] successful.
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9552df3-047c-4bdf-8adb-ac6da0812846]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adefc4a-1563-4c89-bfb9-06d7ed3b3bc0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:00 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:00 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a0959b-0501-4aa4-851b-2d33dba7bfe5]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:46:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLTUeBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-2d4ee31a-539d-4c1e-a526-fd21f6d9a052 req-82a111ae-3105-4edc-ac52-1378b0b81a0c service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2d4ee31a-539d-4c1e-a526-fd21f6d9a052 req-82a111ae-3105-4edc-ac52-1378b0b81a0c service nova] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2d4ee31a-539d-4c1e-a526-fd21f6d9a052 req-82a111ae-3105-4edc-ac52-1378b0b81a0c service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2d4ee31a-539d-4c1e-a526-fd21f6d9a052 req-82a111ae-3105-4edc-ac52-1378b0b81a0c service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-2d4ee31a-539d-4c1e-a526-fd21f6d9a052 req-82a111ae-3105-4edc-ac52-1378b0b81a0c service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] No waiting events found dispatching network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:46:01 user nova-compute[75006]: WARNING nova.compute.manager [req-2d4ee31a-539d-4c1e-a526-fd21f6d9a052 req-82a111ae-3105-4edc-ac52-1378b0b81a0c service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received unexpected event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 for instance with vm_state active and task_state reboot_started_hard.
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:46:01 user nova-compute[75006]: INFO nova.compute.claims [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Claim successful on node user
Nov 27 03:46:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23731363564613530', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731363564613530', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-828253563',display_name='tempest-TestMinimumBasicScenario-server-828253563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-828253563',id=49,image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlrjdH7fytl3Xmar+pijwVOFUpYZbaCcomOMdkgvKJP9pNIMsOuCpVrw60q0QosiHQ/33xAvTCX0LQhPZHfdanCcAEW/2vo8ts4iYhBus9H/2GXMUZ9ZNJn7q3WAHs42g==',key_name='tempest-TestMinimumBasicScenario-1574990255',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-tbvahw6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:45:59Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=3fc62fa4-b1dc-4e19-8a94-46ce222cde28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.objects.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Object Instance<3fc62fa4-b1dc-4e19-8a94-46ce222cde28> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:46:01 user nova-compute[75006]:   <uuid>3fc62fa4-b1dc-4e19-8a94-46ce222cde28</uuid>
Nov 27 03:46:01 user nova-compute[75006]:   <name>instance-00000031</name>
Nov 27 03:46:01 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:46:01 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:46:01 user nova-compute[75006]:   <metadata>
Nov 27 03:46:01 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:46:01 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:46:01 user nova-compute[75006]:       <nova:name>tempest-TestMinimumBasicScenario-server-828253563</nova:name>
Nov 27 03:46:01 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:46:00</nova:creationTime>
Nov 27 03:46:01 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:46:01 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:46:01 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:46:01 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:46:01 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:46:01 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:46:01 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:46:01 user nova-compute[75006]:       <nova:owner>
Nov 27 03:46:01 user nova-compute[75006]:         <nova:user uuid="e3aa8e6a955544d2a360cc6c757d9768">tempest-TestMinimumBasicScenario-1813903653-project-member</nova:user>
Nov 27 03:46:01 user nova-compute[75006]:         <nova:project uuid="547df17332884139955057bf12619e4d">tempest-TestMinimumBasicScenario-1813903653</nova:project>
Nov 27 03:46:01 user nova-compute[75006]:       </nova:owner>
Nov 27 03:46:01 user nova-compute[75006]:       <nova:root type="image" uuid="b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb"/>
Nov 27 03:46:01 user nova-compute[75006]:       <nova:ports>
Nov 27 03:46:01 user nova-compute[75006]:         <nova:port uuid="35dda302-74eb-4b3f-9cdb-55d82cdc4e16">
Nov 27 03:46:01 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 03:46:01 user nova-compute[75006]:         </nova:port>
Nov 27 03:46:01 user nova-compute[75006]:       </nova:ports>
Nov 27 03:46:01 user nova-compute[75006]:     </nova:instance>
Nov 27 03:46:01 user nova-compute[75006]:   </metadata>
Nov 27 03:46:01 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:46:01 user nova-compute[75006]:     <system>
Nov 27 03:46:01 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:46:01 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:46:01 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:46:01 user nova-compute[75006]:       <entry name="serial">3fc62fa4-b1dc-4e19-8a94-46ce222cde28</entry>
Nov 27 03:46:01 user nova-compute[75006]:       <entry name="uuid">3fc62fa4-b1dc-4e19-8a94-46ce222cde28</entry>
Nov 27 03:46:01 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:46:01 user nova-compute[75006]:     </system>
Nov 27 03:46:01 user nova-compute[75006]:   </sysinfo>
Nov 27 03:46:01 user nova-compute[75006]:   <os>
Nov 27 03:46:01 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:46:01 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:46:01 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:46:01 user nova-compute[75006]:   </os>
Nov 27 03:46:01 user nova-compute[75006]:   <features>
Nov 27 03:46:01 user nova-compute[75006]:     <acpi/>
Nov 27 03:46:01 user nova-compute[75006]:     <apic/>
Nov 27 03:46:01 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:46:01 user nova-compute[75006]:   </features>
Nov 27 03:46:01 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:46:01 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:46:01 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:46:01 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:46:01 user nova-compute[75006]:   </clock>
Nov 27 03:46:01 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:46:01 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:46:01 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:46:01 user nova-compute[75006]:   </cpu>
Nov 27 03:46:01 user nova-compute[75006]:   <devices>
Nov 27 03:46:01 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:46:01 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:46:01 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk"/>
Nov 27 03:46:01 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:46:01 user nova-compute[75006]:     </disk>
Nov 27 03:46:01 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:46:01 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:46:01 user nova-compute[75006]:       <source dev="/dev/sdb"/>
Nov 27 03:46:01 user nova-compute[75006]:       <target dev="vdb" bus="virtio"/>
Nov 27 03:46:01 user nova-compute[75006]:       <serial>64b45680-4d23-477d-b9e6-58fbc673e9a2</serial>
Nov 27 03:46:01 user nova-compute[75006]:     </disk>
Nov 27 03:46:01 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:46:01 user nova-compute[75006]:       <mac address="fa:16:3e:87:fe:9d"/>
Nov 27 03:46:01 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:46:01 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:46:01 user nova-compute[75006]:       <target dev="tap35dda302-74"/>
Nov 27 03:46:01 user nova-compute[75006]:     </interface>
Nov 27 03:46:01 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:46:01 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/console.log" append="off"/>
Nov 27 03:46:01 user nova-compute[75006]:     </serial>
Nov 27 03:46:01 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:46:01 user nova-compute[75006]:     <video>
Nov 27 03:46:01 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:46:01 user nova-compute[75006]:     </video>
Nov 27 03:46:01 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:46:01 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:46:01 user nova-compute[75006]:     </rng>
Nov 27 03:46:01 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:46:01 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:46:01 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:46:01 user nova-compute[75006]:     </memballoon>
Nov 27 03:46:01 user nova-compute[75006]:   </devices>
Nov 27 03:46:01 user nova-compute[75006]: </domain>
Nov 27 03:46:01 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:01 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:46:02 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.objects.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Object Instance<3fc62fa4-b1dc-4e19-8a94-46ce222cde28> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:02 user nova-compute[75006]: INFO nova.virt.block_device [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Booting with volume 371da475-1334-4a40-bab4-5cc71d4f95a6 at /dev/vda
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.policy [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee3d2a74e8748c1aa045cc93d4894e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b1b7443dc44f21ac89452277f326b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd --force-share --output=json" returned: 0 in 0.177s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG os_brick.utils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d85b65-8960-4467-bfd7-94c04e613acf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca34452-8890-467c-b27f-eb0e00528bfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[610f1824-8522-4a13-8a87-e1ae039939e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed9fb72-e68d-4906-8643-c09f03a5668f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:46:02 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0728bf-26c0-4ebc-9284-fba6097791dd]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG os_brick.utils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updating existing volume attachment record: d36743a8-e1b3-4671-9e08-36d200a47372 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Cannot resize image /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'migration_context' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.objects.base [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Object Instance<3fc62fa4-b1dc-4e19-8a94-46ce222cde28> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75006) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-828253563',display_name='tempest-TestMinimumBasicScenario-server-828253563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-828253563',id=49,image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlrjdH7fytl3Xmar+pijwVOFUpYZbaCcomOMdkgvKJP9pNIMsOuCpVrw60q0QosiHQ/33xAvTCX0LQhPZHfdanCcAEW/2vo8ts4iYhBus9H/2GXMUZ9ZNJn7q3WAHs42g==',key_name='tempest-TestMinimumBasicScenario-1574990255',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-tbvahw6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:45:59Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=3fc62fa4-b1dc-4e19-8a94-46ce222cde28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG os_vif [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5dbe356-98fb-5df5-8b90-34370332052a', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35dda302-74, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35dda302-74, col_values=(('qos', UUID('14d91171-78c6-4f70-8a3e-102eff34fd32')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35dda302-74, col_values=(('external_ids', {'iface-id': '35dda302-74eb-4b3f-9cdb-55d82cdc4e16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:fe:9d', 'vm-uuid': '3fc62fa4-b1dc-4e19-8a94-46ce222cde28'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:46:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:02 user nova-compute[75006]: INFO os_vif [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74')
Nov 27 03:46:02 user nova-compute[75006]: DEBUG nova.network.neutron [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Successfully created port: 60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Successfully updated port: 60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquired lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-33970583-84ec-444d-95b0-22be1f056603 req-8392598c-0a97-430f-baf2-e15f3f0c79e6 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-changed-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-33970583-84ec-444d-95b0-22be1f056603 req-8392598c-0a97-430f-baf2-e15f3f0c79e6 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Refreshing instance network info cache due to event network-changed-60da19e1-4df8-4fab-9d2a-a5d4010ace63. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-33970583-84ec-444d-95b0-22be1f056603 req-8392598c-0a97-430f-baf2-e15f3f0c79e6 service nova] Acquiring lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG nova.network.neutron [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updating instance_info_cache with network_info: [{"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Releasing lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Instance network_info: |[{"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-33970583-84ec-444d-95b0-22be1f056603 req-8392598c-0a97-430f-baf2-e15f3f0c79e6 service nova] Acquired lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:46:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-33970583-84ec-444d-95b0-22be1f056603 req-8392598c-0a97-430f-baf2-e15f3f0c79e6 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Refreshing network info cache for port 60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-0096c8d4-5f8a-466e-b596-f933c2b157a4 req-398984be-c000-4dcf-bccc-1f4a3335450c service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0096c8d4-5f8a-466e-b596-f933c2b157a4 req-398984be-c000-4dcf-bccc-1f4a3335450c service nova] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0096c8d4-5f8a-466e-b596-f933c2b157a4 req-398984be-c000-4dcf-bccc-1f4a3335450c service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-0096c8d4-5f8a-466e-b596-f933c2b157a4 req-398984be-c000-4dcf-bccc-1f4a3335450c service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG nova.compute.manager [req-0096c8d4-5f8a-466e-b596-f933c2b157a4 req-398984be-c000-4dcf-bccc-1f4a3335450c service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] No waiting events found dispatching network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:46:04 user nova-compute[75006]: WARNING nova.compute.manager [req-0096c8d4-5f8a-466e-b596-f933c2b157a4 req-398984be-c000-4dcf-bccc-1f4a3335450c service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received unexpected event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 for instance with vm_state active and task_state reboot_started_hard.
Nov 27 03:46:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-33970583-84ec-444d-95b0-22be1f056603 req-8392598c-0a97-430f-baf2-e15f3f0c79e6 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updated VIF entry in instance network info cache for port 60da19e1-4df8-4fab-9d2a-a5d4010ace63. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG nova.network.neutron [req-33970583-84ec-444d-95b0-22be1f056603 req-8392598c-0a97-430f-baf2-e15f3f0c79e6 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updating instance_info_cache with network_info: [{"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-33970583-84ec-444d-95b0-22be1f056603 req-8392598c-0a97-430f-baf2-e15f3f0c79e6 service nova] Releasing lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:04 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:05 user nova-compute[75006]: INFO nova.compute.manager [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attaching volume fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 to /dev/vdb
Nov 27 03:46:05 user nova-compute[75006]: DEBUG os_brick.utils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b51ac5e-ab23-47e9-8633-a580cfbe7ff9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bfa40c-8ccf-40ab-b15a-4552e9515f60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305e551-5700-4cab-b2de-c4ca72fd2d86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceafd42-ee84-4ad4-97bd-171c64821161]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:46:05 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:46:05 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eef4bb-1556-4e47-97fa-8f17122e1e8d]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG os_brick.utils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:46:05 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating existing volume attachment record: 806671e2-1708-46c9-9862-2f1f7fb5dc35 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:46:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-3bf35cdd-22ce-43ca-869b-22a756dd01a6 req-3bd99651-28ba-4fc4-b5f2-038d3253c386 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3bf35cdd-22ce-43ca-869b-22a756dd01a6 req-3bd99651-28ba-4fc4-b5f2-038d3253c386 service nova] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3bf35cdd-22ce-43ca-869b-22a756dd01a6 req-3bd99651-28ba-4fc4-b5f2-038d3253c386 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3bf35cdd-22ce-43ca-869b-22a756dd01a6 req-3bd99651-28ba-4fc4-b5f2-038d3253c386 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:06 user nova-compute[75006]: DEBUG nova.compute.manager [req-3bf35cdd-22ce-43ca-869b-22a756dd01a6 req-3bd99651-28ba-4fc4-b5f2-038d3253c386 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] No waiting events found dispatching network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:46:06 user nova-compute[75006]: WARNING nova.compute.manager [req-3bf35cdd-22ce-43ca-869b-22a756dd01a6 req-3bd99651-28ba-4fc4-b5f2-038d3253c386 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received unexpected event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 for instance with vm_state active and task_state reboot_started_hard.
Nov 27 03:46:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:46:06 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Instance rebooted successfully.
Nov 27 03:46:06 user nova-compute[75006]: DEBUG nova.compute.manager [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:46:06 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6dd66251-a785-4ad6-a60b-e00956c828ea tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.960s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:46:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:46:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:46:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:46:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [{"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:46:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-21797e41-8096-4cad-bb21-e877b40115eb" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:46:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:46:09 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Creating image(s)
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Ensure instance console log exists: /opt/stack/data/nova/instances/cf5ef78b-2044-44ed-8553-b2495bee68d8/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Start _get_guest_xml network_info=[{"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'd36743a8-e1b3-4671-9e08-36d200a47372', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSuUiYxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cf5ef78b-2044-44ed-8553-b2495bee68d8', 'attached_at': '', 'detached_at': '', 'volume_id': '371da475-1334-4a40-bab4-5cc71d4f95a6', 'serial': '371da475-1334-4a40-bab4-5cc71d4f95a6'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:46:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:46:09 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSuUiYxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:46:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:09 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:09 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f307d7f7-128c-4c93-904a-592415b965f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:46:09 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b50e0eb-477a-4f2d-9064-a062a3cf1645]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6] added
Nov 27 03:46:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[972ee846-a125-4d09-a75a-b6ea800b6f9f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65cdc3b-3a80-47f9-975f-469dae265f2e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSuUiYxo {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PSuUiYxo" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d033e8-4f65-45b2-9106-18fa59fb7473]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PSuUiYxo'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[de78e8e5-e372-4029-9f6c-589fe9da1778]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8a8095-4cb4-4677-b7e3-1781e181942e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:09 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:09 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb12a1e-55d7-4aac-9ea4-3b8114710a84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260]
Nov 27 03:46:09 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260] successful.
Nov 27 03:46:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e599694a-8f03-4bc8-9dfe-5ec526eebf84]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[95762294-9adc-4d47-bbf4-abd3e6fbfc7a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:09 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:09 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:09 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:09 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:09 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b98c358-c5af-4c20-be85-9d2802c2a30a]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSuUiYxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23563323661636363', 'path': '/dev/sdc'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563323661636363', 'path': '/dev/sdc'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-53405435',display_name='tempest-TestVolumeBootPattern-server-53405435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-53405435',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-ildqrebm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:46:02Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=cf5ef78b-2044-44ed-8553-b2495bee68d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d8:64,bridge_name='br-int',has_traffic_filtering=True,id=60da19e1-4df8-4fab-9d2a-a5d4010ace63,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da19e1-4d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'pci_devices' on Instance uuid cf5ef78b-2044-44ed-8553-b2495bee68d8 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:46:10 user nova-compute[75006]:   <uuid>cf5ef78b-2044-44ed-8553-b2495bee68d8</uuid>
Nov 27 03:46:10 user nova-compute[75006]:   <name>instance-00000032</name>
Nov 27 03:46:10 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:46:10 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:46:10 user nova-compute[75006]:   <metadata>
Nov 27 03:46:10 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:46:10 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:46:10 user nova-compute[75006]:       <nova:name>tempest-TestVolumeBootPattern-server-53405435</nova:name>
Nov 27 03:46:10 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:46:09</nova:creationTime>
Nov 27 03:46:10 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:46:10 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:46:10 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:46:10 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:46:10 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:46:10 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:46:10 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:46:10 user nova-compute[75006]:       <nova:owner>
Nov 27 03:46:10 user nova-compute[75006]:         <nova:user uuid="bee3d2a74e8748c1aa045cc93d4894e5">tempest-TestVolumeBootPattern-1716945418-project-member</nova:user>
Nov 27 03:46:10 user nova-compute[75006]:         <nova:project uuid="46b1b7443dc44f21ac89452277f326b1">tempest-TestVolumeBootPattern-1716945418</nova:project>
Nov 27 03:46:10 user nova-compute[75006]:       </nova:owner>
Nov 27 03:46:10 user nova-compute[75006]:       <nova:ports>
Nov 27 03:46:10 user nova-compute[75006]:         <nova:port uuid="60da19e1-4df8-4fab-9d2a-a5d4010ace63">
Nov 27 03:46:10 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 03:46:10 user nova-compute[75006]:         </nova:port>
Nov 27 03:46:10 user nova-compute[75006]:       </nova:ports>
Nov 27 03:46:10 user nova-compute[75006]:     </nova:instance>
Nov 27 03:46:10 user nova-compute[75006]:   </metadata>
Nov 27 03:46:10 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:46:10 user nova-compute[75006]:     <system>
Nov 27 03:46:10 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:46:10 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:46:10 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:46:10 user nova-compute[75006]:       <entry name="serial">cf5ef78b-2044-44ed-8553-b2495bee68d8</entry>
Nov 27 03:46:10 user nova-compute[75006]:       <entry name="uuid">cf5ef78b-2044-44ed-8553-b2495bee68d8</entry>
Nov 27 03:46:10 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:46:10 user nova-compute[75006]:     </system>
Nov 27 03:46:10 user nova-compute[75006]:   </sysinfo>
Nov 27 03:46:10 user nova-compute[75006]:   <os>
Nov 27 03:46:10 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:46:10 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:46:10 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:46:10 user nova-compute[75006]:   </os>
Nov 27 03:46:10 user nova-compute[75006]:   <features>
Nov 27 03:46:10 user nova-compute[75006]:     <acpi/>
Nov 27 03:46:10 user nova-compute[75006]:     <apic/>
Nov 27 03:46:10 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:46:10 user nova-compute[75006]:   </features>
Nov 27 03:46:10 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:46:10 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:46:10 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:46:10 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:46:10 user nova-compute[75006]:   </clock>
Nov 27 03:46:10 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:46:10 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:46:10 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:46:10 user nova-compute[75006]:   </cpu>
Nov 27 03:46:10 user nova-compute[75006]:   <devices>
Nov 27 03:46:10 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:46:10 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:46:10 user nova-compute[75006]:       <source dev="/dev/sdc"/>
Nov 27 03:46:10 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:46:10 user nova-compute[75006]:       <serial>371da475-1334-4a40-bab4-5cc71d4f95a6</serial>
Nov 27 03:46:10 user nova-compute[75006]:     </disk>
Nov 27 03:46:10 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:46:10 user nova-compute[75006]:       <mac address="fa:16:3e:98:d8:64"/>
Nov 27 03:46:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:46:10 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:46:10 user nova-compute[75006]:       <target dev="tap60da19e1-4d"/>
Nov 27 03:46:10 user nova-compute[75006]:     </interface>
Nov 27 03:46:10 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:46:10 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/cf5ef78b-2044-44ed-8553-b2495bee68d8/console.log" append="off"/>
Nov 27 03:46:10 user nova-compute[75006]:     </serial>
Nov 27 03:46:10 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:46:10 user nova-compute[75006]:     <video>
Nov 27 03:46:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:46:10 user nova-compute[75006]:     </video>
Nov 27 03:46:10 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:46:10 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:46:10 user nova-compute[75006]:     </rng>
Nov 27 03:46:10 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:46:10 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:46:10 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:46:10 user nova-compute[75006]:     </memballoon>
Nov 27 03:46:10 user nova-compute[75006]:   </devices>
Nov 27 03:46:10 user nova-compute[75006]: </domain>
Nov 27 03:46:10 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-53405435',display_name='tempest-TestVolumeBootPattern-server-53405435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-53405435',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-ildqrebm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:46:02Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=cf5ef78b-2044-44ed-8553-b2495bee68d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:d8:64,bridge_name='br-int',has_traffic_filtering=True,id=60da19e1-4df8-4fab-9d2a-a5d4010ace63,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da19e1-4d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG os_vif [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d8:64,bridge_name='br-int',has_traffic_filtering=True,id=60da19e1-4df8-4fab-9d2a-a5d4010ace63,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da19e1-4d') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6966e8a-8093-5906-a5ad-70c3987c88ae', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60da19e1-4d, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60da19e1-4d, col_values=(('qos', UUID('a96d5431-0051-4ae1-9076-82ed76ebdd0a')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60da19e1-4d, col_values=(('external_ids', {'iface-id': '60da19e1-4df8-4fab-9d2a-a5d4010ace63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:d8:64', 'vm-uuid': 'cf5ef78b-2044-44ed-8553-b2495bee68d8'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:10 user nova-compute[75006]: INFO os_vif [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:d8:64,bridge_name='br-int',has_traffic_filtering=True,id=60da19e1-4df8-4fab-9d2a-a5d4010ace63,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da19e1-4d')
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No VIF found with MAC fa:16:3e:98:d8:64, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:10 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:46:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2b7598c-4316-4e1c-85ef-40329cc0e405 req-316c8ca1-c1d2-4334-bebf-55b44744e963 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2b7598c-4316-4e1c-85ef-40329cc0e405 req-316c8ca1-c1d2-4334-bebf-55b44744e963 service nova] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2b7598c-4316-4e1c-85ef-40329cc0e405 req-316c8ca1-c1d2-4334-bebf-55b44744e963 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-b2b7598c-4316-4e1c-85ef-40329cc0e405 req-316c8ca1-c1d2-4334-bebf-55b44744e963 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG nova.compute.manager [req-b2b7598c-4316-4e1c-85ef-40329cc0e405 req-316c8ca1-c1d2-4334-bebf-55b44744e963 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] No waiting events found dispatching network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:46:12 user nova-compute[75006]: WARNING nova.compute.manager [req-b2b7598c-4316-4e1c-85ef-40329cc0e405 req-316c8ca1-c1d2-4334-bebf-55b44744e963 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received unexpected event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 for instance with vm_state building and task_state spawning.
Nov 27 03:46:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGAyTdgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:46:12 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:12 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:12 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9af06c-d671-4560-9cee-f98bba7c9075]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:46:12 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70dfbd-ae8e-4c1d-bab0-d111dd87b39d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150] added
Nov 27 03:46:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77cd467-be5c-4216-94af-3ce1f49b4603]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[17deceef-27bc-4b1d-8e9e-d36d8d5bb2cf]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGAyTdgf {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGAyTdgf" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[06320e46-b970-40c8-8e3c-60bbbd32ab39]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lGAyTdgf'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bda6d83-6d77-4162-8d1a-f0a2b77dbf08]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3265223a-a1aa-4d82-a75c-7c5ad8661018]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2130e459-6560-4f53-920f-8b763489cd90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150, portal: 172.16.0.220,3260]
Nov 27 03:46:12 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150, portal: 172.16.0.220,3260] successful.
Nov 27 03:46:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[474223de-cf45-4cf5-9820-671ca0543d6f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9339c342-7280-4ab7-bd61-e00eff971fa9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)
Nov 27 03:46:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db3be9-967d-4eb7-a72d-5c452410709a]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGAyTdgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23634316431613765', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634316431613765', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:46:13 user nova-compute[75006]: DEBUG nova.objects.instance [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-6d896f39-20e4-4aa8-ad5d-42bc0a3833f6 req-41949d70-f98b-4651-b195-ee9708b4a742 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6d896f39-20e4-4aa8-ad5d-42bc0a3833f6 req-41949d70-f98b-4651-b195-ee9708b4a742 service nova] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6d896f39-20e4-4aa8-ad5d-42bc0a3833f6 req-41949d70-f98b-4651-b195-ee9708b4a742 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6d896f39-20e4-4aa8-ad5d-42bc0a3833f6 req-41949d70-f98b-4651-b195-ee9708b4a742 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.manager [req-6d896f39-20e4-4aa8-ad5d-42bc0a3833f6 req-41949d70-f98b-4651-b195-ee9708b4a742 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] No waiting events found dispatching network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:46:14 user nova-compute[75006]: WARNING nova.compute.manager [req-6d896f39-20e4-4aa8-ad5d-42bc0a3833f6 req-41949d70-f98b-4651-b195-ee9708b4a742 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received unexpected event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 for instance with vm_state building and task_state spawning.
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:46:14 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:46:14 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:46:14 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:46:14 user nova-compute[75006]:   <serial>fdb53f1f-ce3c-440f-8c32-30c0ac9ea150</serial>
Nov 27 03:46:14 user nova-compute[75006]: </disk>
Nov 27 03:46:14 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:46:14 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:46:14 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8493MB free_disk=25.081214904785156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:14 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Instance spawned successfully.
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:46:14 user nova-compute[75006]: INFO nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 21797e41-8096-4cad-bb21-e877b40115eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c714a10b-bf0a-4817-986c-6a9474166aff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cf5ef78b-2044-44ed-8553-b2495bee68d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:46:14 user nova-compute[75006]: INFO nova.compute.manager [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Took 13.11 seconds to build instance.
Nov 27 03:46:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-385c2863-436b-4071-8ee5-02191f63d5ab tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.230s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:46:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No VIF found with MAC fa:16:3e:5a:60:82, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:46:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-0db17509-b202-446c-9871-bd269d51f7cd tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.605s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:15 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:15 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:46:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:16 user nova-compute[75006]: INFO nova.compute.manager [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Detaching volume fdb53f1f-ce3c-440f-8c32-30c0ac9ea150
Nov 27 03:46:17 user nova-compute[75006]: INFO nova.virt.block_device [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attempting to driver detach volume fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 from mountpoint /dev/vdb
Nov 27 03:46:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Attempting to detach device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:46:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:46:17 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:46:17 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:46:17 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:46:17 user nova-compute[75006]:   <serial>fdb53f1f-ce3c-440f-8c32-30c0ac9ea150</serial>
Nov 27 03:46:17 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:46:17 user nova-compute[75006]: </disk>
Nov 27 03:46:17 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:46:17 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully detached device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the persistent domain config.
Nov 27 03:46:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c714a10b-bf0a-4817-986c-6a9474166aff from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:46:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:46:17 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:46:17 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:46:17 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:46:17 user nova-compute[75006]:   <serial>fdb53f1f-ce3c-440f-8c32-30c0ac9ea150</serial>
Nov 27 03:46:17 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:46:17 user nova-compute[75006]: </disk>
Nov 27 03:46:17 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:46:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:46:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:36 user nova-compute[75006]: INFO nova.compute.manager [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Terminating instance
Nov 27 03:46:36 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-6e6b6d33-7e1d-4ab6-a863-eeaab41d3851 req-d4f661d1-3a20-4fe7-a7ae-1ec9f6e305d5 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6e6b6d33-7e1d-4ab6-a863-eeaab41d3851 req-d4f661d1-3a20-4fe7-a7ae-1ec9f6e305d5 service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6e6b6d33-7e1d-4ab6-a863-eeaab41d3851 req-d4f661d1-3a20-4fe7-a7ae-1ec9f6e305d5 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6e6b6d33-7e1d-4ab6-a863-eeaab41d3851 req-d4f661d1-3a20-4fe7-a7ae-1ec9f6e305d5 service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-6e6b6d33-7e1d-4ab6-a863-eeaab41d3851 req-d4f661d1-3a20-4fe7-a7ae-1ec9f6e305d5 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:46:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-6e6b6d33-7e1d-4ab6-a863-eeaab41d3851 req-d4f661d1-3a20-4fe7-a7ae-1ec9f6e305d5 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-unplugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:46:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Instance destroyed successfully.
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.objects.instance [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'resources' on Instance uuid 21797e41-8096-4cad-bb21-e877b40115eb {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:40:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1522594165',display_name='tempest-ServerActionsTestOtherA-server-1522594165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1522594165',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:42:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-s8g0wxwt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=21797e41-8096-4cad-bb21-e877b40115eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "address": "fa:16:3e:63:b4:49", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb9a8411-fa", "ovs_interfaceid": "cb9a8411-fa00-4a4d-bea2-ede8472b9ec4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_vif [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb9a8411-fa, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1912f153-3b53-482d-8213-01f196f544c1) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:46:37 user nova-compute[75006]: INFO os_vif [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:b4:49,bridge_name='br-int',has_traffic_filtering=True,id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb9a8411-fa')
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqCirFpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:46:37 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e10cb98-a6a1-41cb-bd82-47d9123dfb9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:46:37 user nova-compute[75006]: No targets found.
Nov 27 03:46:37 user nova-compute[75006]: iSNS:
Nov 27 03:46:37 user nova-compute[75006]: No targets found.
Nov 27 03:46:37 user nova-compute[75006]: STATIC:
Nov 27 03:46:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f
Nov 27 03:46:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150
Nov 27 03:46:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2
Nov 27 03:46:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:46:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:37 user nova-compute[75006]: FIRMWARE:
Nov 27 03:46:37 user nova-compute[75006]: No targets found.
Nov 27 03:46:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:46:37 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:46:37 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3fd8f2-6846-4044-9a19-f3510a18bd6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cce6be0-2a6b-41e7-bbce-6d082f5c6a3b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f'): ({'sde'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Removing single pathed devices sde {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a2247b-852c-4f3a-951f-0769567b677a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[02380819-7871-4e89-886f-b851a7993afd]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Flushing IO for device /dev/sde {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4539461d-1042-44a3-aebb-eabd8b5df288]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bab875f-8ae8-4482-824c-f8a9673ce4a8]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] SCSI volumes sde have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[110871c8-099b-41f4-a316-8cb0f8bc1ae4]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[51199177-31da-4bbc-bd17-569f50f29162]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260]
Nov 27 03:46:37 user nova-compute[75006]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f, portal: 172.16.0.220,3260] successful.
Nov 27 03:46:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c714a10b-bf0a-4817-986c-6a9474166aff is timed out.
Nov 27 03:46:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully detached device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the live domain config.
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b29040-6513-48c6-9738-266741f4983f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGAyTdgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:46:37 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b200bdf1-1aaa-409f-93e3-cdd237f25569]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] <== disconnect_volume: return (342ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:46:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Deleting instance files /opt/stack/data/nova/instances/21797e41-8096-4cad-bb21-e877b40115eb_del
Nov 27 03:46:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Deletion of /opt/stack/data/nova/instances/21797e41-8096-4cad-bb21-e877b40115eb_del complete
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.008s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d022116c-1b90-4a26-838d-cbe2810033bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:46:37 user nova-compute[75006]: No targets found.
Nov 27 03:46:37 user nova-compute[75006]: iSNS:
Nov 27 03:46:37 user nova-compute[75006]: No targets found.
Nov 27 03:46:37 user nova-compute[75006]: STATIC:
Nov 27 03:46:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150
Nov 27 03:46:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2
Nov 27 03:46:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:37 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:46:37 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:46:37 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:46:37 user nova-compute[75006]: FIRMWARE:
Nov 27 03:46:37 user nova-compute[75006]: No targets found.
Nov 27 03:46:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:46:37 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:46:37 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[82604ba8-9549-4a0e-bde4-e22938c63eab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: INFO nova.compute.manager [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda5ec15-4bd0-444e-adc9-04f58c441fc1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 (non-flash)
Nov 27 03:46:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c243400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c0f140-af6f-4456-bfce-4178a3609402]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0a92bd-49ed-47e2-9ffe-30914b3dea73]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aca39ee-d531-42c9-8c01-b73fe1754c51]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e936c1f-5503-4660-b6df-b4796c4faffe]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b6fc2a-b56b-4f95-81ba-ad1ef5d607d0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d37bbe4-f87f-4ba1-bccf-5f0ed520b643]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150, portal: 172.16.0.220,3260]
Nov 27 03:46:37 user nova-compute[75006]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150, portal: 172.16.0.220,3260] successful.
Nov 27 03:46:37 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdb53f1f-ce3c-440f-8c32-30c0ac9ea150 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.082s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf81f0f-d12c-4506-a705-235254058d71]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== disconnect_volume: return (370ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:46:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:46:38 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:46:38 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Took 0.85 seconds to deallocate network for instance.
Nov 27 03:46:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-2932c473-4281-47e1-b6bb-4249f3b670c8 req-49068d57-97f8-463e-8f41-0656abbf8cf4 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-deleted-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:38 user nova-compute[75006]: INFO nova.compute.manager [req-2932c473-4281-47e1-b6bb-4249f3b670c8 req-49068d57-97f8-463e-8f41-0656abbf8cf4 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Neutron deleted interface cb9a8411-fa00-4a4d-bea2-ede8472b9ec4; detaching it from the instance and deleting it from the info cache
Nov 27 03:46:38 user nova-compute[75006]: DEBUG nova.network.neutron [req-2932c473-4281-47e1-b6bb-4249f3b670c8 req-49068d57-97f8-463e-8f41-0656abbf8cf4 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:46:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-2932c473-4281-47e1-b6bb-4249f3b670c8 req-49068d57-97f8-463e-8f41-0656abbf8cf4 service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Detach interface failed, port_id=cb9a8411-fa00-4a4d-bea2-ede8472b9ec4, reason: Instance 21797e41-8096-4cad-bb21-e877b40115eb could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:46:38 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:46:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-258c2cbe-c60e-4809-8fc4-cdb5c085f9ad req-06f6b73b-2252-4cad-b226-b5db5acf469d service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:46:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-258c2cbe-c60e-4809-8fc4-cdb5c085f9ad req-06f6b73b-2252-4cad-b226-b5db5acf469d service nova] Acquiring lock "21797e41-8096-4cad-bb21-e877b40115eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-258c2cbe-c60e-4809-8fc4-cdb5c085f9ad req-06f6b73b-2252-4cad-b226-b5db5acf469d service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-258c2cbe-c60e-4809-8fc4-cdb5c085f9ad req-06f6b73b-2252-4cad-b226-b5db5acf469d service nova] Lock "21797e41-8096-4cad-bb21-e877b40115eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-258c2cbe-c60e-4809-8fc4-cdb5c085f9ad req-06f6b73b-2252-4cad-b226-b5db5acf469d service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] No waiting events found dispatching network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:46:38 user nova-compute[75006]: WARNING nova.compute.manager [req-258c2cbe-c60e-4809-8fc4-cdb5c085f9ad req-06f6b73b-2252-4cad-b226-b5db5acf469d service nova] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Received unexpected event network-vif-plugged-cb9a8411-fa00-4a4d-bea2-ede8472b9ec4 for instance with vm_state active and task_state deleting.
Nov 27 03:46:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b8c6d88f-cb8e-41c4-9a3e-e2979ef55262 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.886s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:39 user nova-compute[75006]: INFO nova.compute.manager [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Took 0.72 seconds to detach 1 volumes for instance.
Nov 27 03:46:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 21797e41-8096-4cad-bb21-e877b40115eb] Deleting volume: 23b29040-6513-48c6-9738-266741f4983f {{(pid=75006) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 03:46:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:46:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:46:39 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:46:39 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:46:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:39 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Deleted allocations for instance 21797e41-8096-4cad-bb21-e877b40115eb
Nov 27 03:46:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-e133a216-e97c-4e6e-a519-2e8f011a54d6 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "21797e41-8096-4cad-bb21-e877b40115eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:46:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:46:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:46:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:46:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:46:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:46:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:47:05 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:47:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:47:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:47:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:47:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:47:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating instance_info_cache with network_info: [{"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:47:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:47:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:47:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:08 user nova-compute[75006]: DEBUG nova.objects.instance [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:09 user nova-compute[75006]: INFO nova.compute.manager [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attaching volume b974c1c0-e87d-40f5-8ff4-0021830a2c0c to /dev/vdb
Nov 27 03:47:09 user nova-compute[75006]: DEBUG os_brick.utils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ac4553-9df4-4245-bfe5-76dc6568a596]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30afd9a1-06bd-40a7-8ffa-79101ad138a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cacbf7-2085-4c7d-b7f3-1ea4b79edbc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e82a16-a909-4c47-901f-f337d6124b7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:47:09 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:47:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bb6e19-309b-40bb-941f-23f487e18dbc]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG os_brick.utils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:47:09 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating existing volume attachment record: a5404383-eea1-47d8-94c1-1384c584ed49 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:47:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:47:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:47:14 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:47:14 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=25.078475952148438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 87c685b0-44b9-400b-b98a-2066988857f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c714a10b-bf0a-4817-986c-6a9474166aff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cf5ef78b-2044-44ed-8553-b2495bee68d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:47:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIHYXGxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:47:15 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:47:15 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:47:15 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c891b4ed-5439-430a-a0b9-9745117577bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:47:15 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab79300-135b-4900-b3cc-7fc09e14b366]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c] added
Nov 27 03:47:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7423d22-d2ef-4590-9505-46ffdaaaeb47]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6672162c-27ef-4c0e-8f2d-94abf7ffe1fd]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIHYXGxA {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FIHYXGxA" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f017b3-c1d8-46cf-8e3d-a256e90b6e80]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FIHYXGxA'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb8759-246a-4d43-b03e-0a0d45cd74c7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d97930-f8ce-4dec-b770-34a736eabaf8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:47:15 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:47:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:47:15 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:47:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d8aac-85ac-41bf-bd19-726d6d194d7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c, portal: 172.16.0.220,3260]
Nov 27 03:47:15 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c, portal: 172.16.0.220,3260] successful.
Nov 27 03:47:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd23706-0fda-4c89-821d-cf98afe15777]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7843896-8a3c-4fd3-b5fa-7653a8dee5f3]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:47:15 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:47:15 user nova-compute[75006]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c (non-flash)
Nov 27 03:47:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:47:15 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:47:15 user nova-compute[75006]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c (non-flash)
Nov 27 03:47:15 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c24def4-347b-48f5-9f6a-4dfd813984ca]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:47:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIHYXGxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:47:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:47:16 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26664393930366361', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:47:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664393930366361', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:47:16 user nova-compute[75006]: DEBUG nova.objects.instance [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:47:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:47:16 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:47:16 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:47:16 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:47:16 user nova-compute[75006]:   <serial>b974c1c0-e87d-40f5-8ff4-0021830a2c0c</serial>
Nov 27 03:47:16 user nova-compute[75006]: </disk>
Nov 27 03:47:16 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:47:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:47:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:47:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No VIF found with MAC fa:16:3e:5a:60:82, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:47:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-df308f6a-2af1-4830-a9dc-5081fad9a392 tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.893s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:19 user nova-compute[75006]: INFO nova.compute.manager [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Detaching volume b974c1c0-e87d-40f5-8ff4-0021830a2c0c
Nov 27 03:47:19 user nova-compute[75006]: INFO nova.virt.block_device [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attempting to driver detach volume b974c1c0-e87d-40f5-8ff4-0021830a2c0c from mountpoint /dev/vdb
Nov 27 03:47:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Attempting to detach device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:47:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:47:19 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:47:19 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:47:19 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:47:19 user nova-compute[75006]:   <serial>b974c1c0-e87d-40f5-8ff4-0021830a2c0c</serial>
Nov 27 03:47:19 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:47:19 user nova-compute[75006]: </disk>
Nov 27 03:47:19 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:47:19 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully detached device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the persistent domain config.
Nov 27 03:47:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c714a10b-bf0a-4817-986c-6a9474166aff from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:47:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:47:19 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:47:19 user nova-compute[75006]:   <source dev="/dev/sdd"/>
Nov 27 03:47:19 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:47:19 user nova-compute[75006]:   <serial>b974c1c0-e87d-40f5-8ff4-0021830a2c0c</serial>
Nov 27 03:47:19 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:47:19 user nova-compute[75006]: </disk>
Nov 27 03:47:19 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:47:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:47:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:47:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "87c685b0-44b9-400b-b98a-2066988857f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:30 user nova-compute[75006]: INFO nova.compute.manager [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Terminating instance
Nov 27 03:47:30 user nova-compute[75006]: DEBUG nova.compute.manager [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-5b070544-1e4e-40e5-98e3-6cc9374c7cdb req-b60f8025-bbd6-4b28-af58-ab01ff40d84a service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-vif-unplugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5b070544-1e4e-40e5-98e3-6cc9374c7cdb req-b60f8025-bbd6-4b28-af58-ab01ff40d84a service nova] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5b070544-1e4e-40e5-98e3-6cc9374c7cdb req-b60f8025-bbd6-4b28-af58-ab01ff40d84a service nova] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5b070544-1e4e-40e5-98e3-6cc9374c7cdb req-b60f8025-bbd6-4b28-af58-ab01ff40d84a service nova] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-5b070544-1e4e-40e5-98e3-6cc9374c7cdb req-b60f8025-bbd6-4b28-af58-ab01ff40d84a service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] No waiting events found dispatching network-vif-unplugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG nova.compute.manager [req-5b070544-1e4e-40e5-98e3-6cc9374c7cdb req-b60f8025-bbd6-4b28-af58-ab01ff40d84a service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-vif-unplugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:47:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Instance destroyed successfully.
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.objects.instance [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lazy-loading 'resources' on Instance uuid 87c685b0-44b9-400b-b98a-2066988857f4 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:29:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-900982225',display_name='tempest-ServerActionsTestOtherA-server-900982225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-900982225',id=33,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbgBvui2Wh2l+tSY/Bz78OxzlbP4d1FfOWWo8DLYVXqGiCnwdakf+hMR1kXT7rLDuifxX3Tzrfn6FmxM8ivmdyN9AnjNMK21X64niJoIYQ71x3yMX2yCHjeWXSuZ0wKsg==',key_name='tempest-keypair-877783275',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:29:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='daa566d4c0fd4cbdbaf2b67ac2cea59a',ramdisk_id='',reservation_id='r-85mf4sor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-507729530',owner_user_name='tempest-ServerActionsTestOtherA-507729530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4a327fa49cc468f8cbf23ae2d6d30d1',uuid=87c685b0-44b9-400b-b98a-2066988857f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converting VIF {"id": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "address": "fa:16:3e:ea:45:06", "network": {"id": "fb7e5900-6d9e-4c15-a640-bf810219e5a9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-473983752-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "daa566d4c0fd4cbdbaf2b67ac2cea59a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424e4fc6-5f", "ovs_interfaceid": "424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:45:06,bridge_name='br-int',has_traffic_filtering=True,id=424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424e4fc6-5f') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG os_vif [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:45:06,bridge_name='br-int',has_traffic_filtering=True,id=424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424e4fc6-5f') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap424e4fc6-5f, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53492a85-65b6-4275-bccf-99e099a3278d) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:47:31 user nova-compute[75006]: INFO os_vif [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:45:06,bridge_name='br-int',has_traffic_filtering=True,id=424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828,network=Network(fb7e5900-6d9e-4c15-a640-bf810219e5a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424e4fc6-5f')
Nov 27 03:47:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Deleting instance files /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4_del
Nov 27 03:47:31 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Deletion of /opt/stack/data/nova/instances/87c685b0-44b9-400b-b98a-2066988857f4_del complete
Nov 27 03:47:31 user nova-compute[75006]: INFO nova.compute.manager [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 27 03:47:31 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:47:31 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Took 0.36 seconds to deallocate network for instance.
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.compute.manager [req-3803418d-d182-4000-ac3a-bfb606848c29 req-ef09f87e-b155-4db8-8619-8dc2784324ab service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-vif-deleted-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:47:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:31 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Deleted allocations for instance 87c685b0-44b9-400b-b98a-2066988857f4
Nov 27 03:47:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-734c909d-2423-4aa8-aae4-47e797d6ad33 tempest-ServerActionsTestOtherA-507729530 tempest-ServerActionsTestOtherA-507729530-project-member] Lock "87c685b0-44b9-400b-b98a-2066988857f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.651s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-acc02cf9-0620-44df-a4b6-5cfd3f97a3bc req-442c6f7e-7b6d-4d6f-bfab-f11aafe7af26 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received event network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:47:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-acc02cf9-0620-44df-a4b6-5cfd3f97a3bc req-442c6f7e-7b6d-4d6f-bfab-f11aafe7af26 service nova] Acquiring lock "87c685b0-44b9-400b-b98a-2066988857f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-acc02cf9-0620-44df-a4b6-5cfd3f97a3bc req-442c6f7e-7b6d-4d6f-bfab-f11aafe7af26 service nova] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:32 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-acc02cf9-0620-44df-a4b6-5cfd3f97a3bc req-442c6f7e-7b6d-4d6f-bfab-f11aafe7af26 service nova] Lock "87c685b0-44b9-400b-b98a-2066988857f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:32 user nova-compute[75006]: DEBUG nova.compute.manager [req-acc02cf9-0620-44df-a4b6-5cfd3f97a3bc req-442c6f7e-7b6d-4d6f-bfab-f11aafe7af26 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] No waiting events found dispatching network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:47:32 user nova-compute[75006]: WARNING nova.compute.manager [req-acc02cf9-0620-44df-a4b6-5cfd3f97a3bc req-442c6f7e-7b6d-4d6f-bfab-f11aafe7af26 service nova] [instance: 87c685b0-44b9-400b-b98a-2066988857f4] Received unexpected event network-vif-plugged-424e4fc6-5fca-4ecf-b2d9-1fed7f6f9828 for instance with vm_state deleted and task_state None.
Nov 27 03:47:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:39 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c714a10b-bf0a-4817-986c-6a9474166aff is timed out.
Nov 27 03:47:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully detached device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the live domain config.
Nov 27 03:47:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FIHYXGxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:47:39 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:47:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e524c1-af9e-4196-9ae0-a7dab6ff0b2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:47:39 user nova-compute[75006]: No targets found.
Nov 27 03:47:39 user nova-compute[75006]: iSNS:
Nov 27 03:47:39 user nova-compute[75006]: No targets found.
Nov 27 03:47:39 user nova-compute[75006]: STATIC:
Nov 27 03:47:39 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2
Nov 27 03:47:39 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:47:39 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:47:39 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:47:39 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:47:39 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:47:39 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c
Nov 27 03:47:39 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:47:39 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:47:39 user nova-compute[75006]: FIRMWARE:
Nov 27 03:47:39 user nova-compute[75006]: No targets found.
Nov 27 03:47:39 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:47:39 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:47:39 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[88524fcf-34d0-46d1-952d-c9efad0afe51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[820f6f94-d9eb-40ef-8410-6954a9da49cc]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:47:40 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:47:40 user nova-compute[75006]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c (non-flash)
Nov 27 03:47:40 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:47:40 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:47:40 user nova-compute[75006]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c (non-flash)
Nov 27 03:47:40 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4246a9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22be84f-5bf6-4d5d-8330-78447a2bd3dc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d07ac2-214a-49e9-beaf-63f549bdf58c]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd756925-f108-4b1e-80a2-4b3fcb019bf0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc2c9fb-1cd9-4db5-a830-4362203e1f7b]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[da042816-5431-446d-ae71-8a2329635c3b]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a994c3a-206a-4fec-8576-0c4f810ea7ad]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c, portal: 172.16.0.220,3260]
Nov 27 03:47:40 user nova-compute[75006]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c, portal: 172.16.0.220,3260] successful.
Nov 27 03:47:40 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b974c1c0-e87d-40f5-8ff4-0021830a2c0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b493f14-7d79-4c6c-aa94-32c46689ee7d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== disconnect_volume: return (288ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:47:40 user nova-compute[75006]: DEBUG nova.objects.instance [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:47:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-4726135c-1160-446d-beb9-8064f41b445a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:47:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:47:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:47:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:47:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:47:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-37c5f4bd-ab32-4e22-8c59-965486f9c3a2 req-06094be1-c720-43d4-995b-94c2539583a2 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-37c5f4bd-ab32-4e22-8c59-965486f9c3a2 req-06094be1-c720-43d4-995b-94c2539583a2 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing instance network info cache due to event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-37c5f4bd-ab32-4e22-8c59-965486f9c3a2 req-06094be1-c720-43d4-995b-94c2539583a2 service nova] Acquiring lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-37c5f4bd-ab32-4e22-8c59-965486f9c3a2 req-06094be1-c720-43d4-995b-94c2539583a2 service nova] Acquired lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-37c5f4bd-ab32-4e22-8c59-965486f9c3a2 req-06094be1-c720-43d4-995b-94c2539583a2 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-37c5f4bd-ab32-4e22-8c59-965486f9c3a2 req-06094be1-c720-43d4-995b-94c2539583a2 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updated VIF entry in instance network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-37c5f4bd-ab32-4e22-8c59-965486f9c3a2 req-06094be1-c720-43d4-995b-94c2539583a2 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:47:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-37c5f4bd-ab32-4e22-8c59-965486f9c3a2 req-06094be1-c720-43d4-995b-94c2539583a2 service nova] Releasing lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:47:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:51 user nova-compute[75006]: INFO nova.compute.manager [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Detaching volume 64b45680-4d23-477d-b9e6-58fbc673e9a2
Nov 27 03:47:51 user nova-compute[75006]: INFO nova.virt.block_device [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Attempting to driver detach volume 64b45680-4d23-477d-b9e6-58fbc673e9a2 from mountpoint /dev/vdb
Nov 27 03:47:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Attempting to detach device vdb from instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:47:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:47:51 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:47:51 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:47:51 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:47:51 user nova-compute[75006]:   <serial>64b45680-4d23-477d-b9e6-58fbc673e9a2</serial>
Nov 27 03:47:51 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 03:47:51 user nova-compute[75006]: </disk>
Nov 27 03:47:51 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:47:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully detached device vdb from instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 from the persistent domain config.
Nov 27 03:47:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:47:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:47:51 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:47:51 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:47:51 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:47:51 user nova-compute[75006]:   <serial>64b45680-4d23-477d-b9e6-58fbc673e9a2</serial>
Nov 27 03:47:51 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 03:47:51 user nova-compute[75006]: </disk>
Nov 27 03:47:51 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-78734b84-80a0-4f94-a53b-27500368d552 req-b9c14ecc-1f59-4b1d-8c0c-6d6880d889bf service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-78734b84-80a0-4f94-a53b-27500368d552 req-b9c14ecc-1f59-4b1d-8c0c-6d6880d889bf service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing instance network info cache due to event network-changed-35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-78734b84-80a0-4f94-a53b-27500368d552 req-b9c14ecc-1f59-4b1d-8c0c-6d6880d889bf service nova] Acquiring lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-78734b84-80a0-4f94-a53b-27500368d552 req-b9c14ecc-1f59-4b1d-8c0c-6d6880d889bf service nova] Acquired lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-78734b84-80a0-4f94-a53b-27500368d552 req-b9c14ecc-1f59-4b1d-8c0c-6d6880d889bf service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Refreshing network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-78734b84-80a0-4f94-a53b-27500368d552 req-b9c14ecc-1f59-4b1d-8c0c-6d6880d889bf service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updated VIF entry in instance network info cache for port 35dda302-74eb-4b3f-9cdb-55d82cdc4e16. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-78734b84-80a0-4f94-a53b-27500368d552 req-b9c14ecc-1f59-4b1d-8c0c-6d6880d889bf service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:47:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-78734b84-80a0-4f94-a53b-27500368d552 req-b9c14ecc-1f59-4b1d-8c0c-6d6880d889bf service nova] Releasing lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:47:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-9f6ee265-02d3-4a2b-9f52-e10cac28b2fd req-df069ca8-38c7-415d-88af-0d166ff70f98 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-changed-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:47:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-9f6ee265-02d3-4a2b-9f52-e10cac28b2fd req-df069ca8-38c7-415d-88af-0d166ff70f98 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Refreshing instance network info cache due to event network-changed-60da19e1-4df8-4fab-9d2a-a5d4010ace63. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:47:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9f6ee265-02d3-4a2b-9f52-e10cac28b2fd req-df069ca8-38c7-415d-88af-0d166ff70f98 service nova] Acquiring lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:47:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9f6ee265-02d3-4a2b-9f52-e10cac28b2fd req-df069ca8-38c7-415d-88af-0d166ff70f98 service nova] Acquired lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:47:54 user nova-compute[75006]: DEBUG nova.network.neutron [req-9f6ee265-02d3-4a2b-9f52-e10cac28b2fd req-df069ca8-38c7-415d-88af-0d166ff70f98 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Refreshing network info cache for port 60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:47:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-9f6ee265-02d3-4a2b-9f52-e10cac28b2fd req-df069ca8-38c7-415d-88af-0d166ff70f98 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updated VIF entry in instance network info cache for port 60da19e1-4df8-4fab-9d2a-a5d4010ace63. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:47:55 user nova-compute[75006]: DEBUG nova.network.neutron [req-9f6ee265-02d3-4a2b-9f52-e10cac28b2fd req-df069ca8-38c7-415d-88af-0d166ff70f98 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updating instance_info_cache with network_info: [{"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:47:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-9f6ee265-02d3-4a2b-9f52-e10cac28b2fd req-df069ca8-38c7-415d-88af-0d166ff70f98 service nova] Releasing lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:47:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:47:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "46038be1-3a6d-4e48-9053-463d986af885" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "46038be1-3a6d-4e48-9053-463d986af885" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:59 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:47:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:47:59 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:47:59 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:47:59 user nova-compute[75006]: INFO nova.compute.claims [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Claim successful on node user
Nov 27 03:47:59 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:47:59 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:48:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:48:00 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:48:00 user nova-compute[75006]: INFO nova.virt.block_device [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Booting with volume f14f3a50-9479-4ef1-b3ad-d63dd1818222 at /dev/vda
Nov 27 03:48:00 user nova-compute[75006]: DEBUG nova.policy [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bee3d2a74e8748c1aa045cc93d4894e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46b1b7443dc44f21ac89452277f326b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG os_brick.utils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[168d3702-bb4e-42ec-a310-eacb62ae1150]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[524171f8-781a-4352-87cb-34f4838a4d4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[02caec1f-a11c-4bf6-bd8c-38eec291c608]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[417ca9a0-9504-44bb-aa48-d3bf347c1881]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:48:00 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:48:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85d4947-442d-456e-ae83-39a1da3334f8]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG os_brick.utils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updating existing volume attachment record: e6de8352-a28a-4ade-96e3-3e50d9d5f4f5 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:00 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Successfully created port: 684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Successfully updated port: 684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquired lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-d29f68b5-a5df-4f22-a31e-747dc484fd4b req-c517d95c-1b38-4ee8-9dd5-4fd6c3fa881a service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-changed-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG nova.compute.manager [req-d29f68b5-a5df-4f22-a31e-747dc484fd4b req-c517d95c-1b38-4ee8-9dd5-4fd6c3fa881a service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Refreshing instance network info cache due to event network-changed-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d29f68b5-a5df-4f22-a31e-747dc484fd4b req-c517d95c-1b38-4ee8-9dd5-4fd6c3fa881a service nova] Acquiring lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG nova.network.neutron [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updating instance_info_cache with network_info: [{"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Releasing lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Instance network_info: |[{"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d29f68b5-a5df-4f22-a31e-747dc484fd4b req-c517d95c-1b38-4ee8-9dd5-4fd6c3fa881a service nova] Acquired lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:48:01 user nova-compute[75006]: DEBUG nova.network.neutron [req-d29f68b5-a5df-4f22-a31e-747dc484fd4b req-c517d95c-1b38-4ee8-9dd5-4fd6c3fa881a service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Refreshing network info cache for port 684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:48:02 user nova-compute[75006]: DEBUG nova.network.neutron [req-d29f68b5-a5df-4f22-a31e-747dc484fd4b req-c517d95c-1b38-4ee8-9dd5-4fd6c3fa881a service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updated VIF entry in instance network info cache for port 684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:48:02 user nova-compute[75006]: DEBUG nova.network.neutron [req-d29f68b5-a5df-4f22-a31e-747dc484fd4b req-c517d95c-1b38-4ee8-9dd5-4fd6c3fa881a service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updating instance_info_cache with network_info: [{"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:48:02 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-d29f68b5-a5df-4f22-a31e-747dc484fd4b req-c517d95c-1b38-4ee8-9dd5-4fd6c3fa881a service nova] Releasing lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:48:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:06 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:07 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:48:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:48:07 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:48:07 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [{"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-3fc62fa4-b1dc-4e19-8a94-46ce222cde28" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:48:08 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Creating image(s)
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Did not create local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Ensure instance console log exists: /opt/stack/data/nova/instances/46038be1-3a6d-4e48-9053-463d986af885/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Start _get_guest_xml network_info=[{"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'e6de8352-a28a-4ade-96e3-3e50d9d5f4f5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycjreUOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '46038be1-3a6d-4e48-9053-463d986af885', 'attached_at': '', 'detached_at': '', 'volume_id': 'f14f3a50-9479-4ef1-b3ad-d63dd1818222', 'serial': 'f14f3a50-9479-4ef1-b3ad-d63dd1818222'}, 'guest_format': None, 'volume_type': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:48:08 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:48:08 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycjreUOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:48:08 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:48:08 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:48:08 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3bdd7-4953-442f-aad3-c23ea9914b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:48:08 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e608d5a9-6c0e-4dd9-b9f0-157adda272c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222] added
Nov 27 03:48:08 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.081s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f170b283-88f0-4a9e-bfbe-7e559f58143e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5d8e28-f8be-4e0b-b58a-3bc9bc3623fb]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycjreUOp {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycjreUOp" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e33f1dc-eb6e-4684-99fa-6300753a2ef5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycjreUOp'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ddee16-a26c-4b1f-9960-d51c3e5ca496]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f15ddab-5fdf-4736-9830-485a151acedb]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d7d7ec-846c-4db9-bbf5-99b5bdd58f48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222, portal: 172.16.0.220,3260]
Nov 27 03:48:08 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222, portal: 172.16.0.220,3260] successful.
Nov 27 03:48:08 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a698e1-c83f-4257-b932-43c0bdcbad92]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa2c992-dca2-4e37-96fb-241bfd19cbbc]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:08 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:48:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:09 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:09 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e01518-e45d-49a9-b656-e2842947cd14]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:09 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:48:09 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycjreUOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23963316630633738', 'path': '/dev/sdd'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963316630633738', 'path': '/dev/sdd'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-169684316',display_name='tempest-TestVolumeBootPattern-server-169684316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-169684316',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-3ub893pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:48:00Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=46038be1-3a6d-4e48-9053-463d986af885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:66:68,bridge_name='br-int',has_traffic_filtering=True,id=684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap684d6aa2-c1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.objects.instance [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'pci_devices' on Instance uuid 46038be1-3a6d-4e48-9053-463d986af885 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:48:10 user nova-compute[75006]:   <uuid>46038be1-3a6d-4e48-9053-463d986af885</uuid>
Nov 27 03:48:10 user nova-compute[75006]:   <name>instance-00000033</name>
Nov 27 03:48:10 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:48:10 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:48:10 user nova-compute[75006]:   <metadata>
Nov 27 03:48:10 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:48:10 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:48:10 user nova-compute[75006]:       <nova:name>tempest-TestVolumeBootPattern-server-169684316</nova:name>
Nov 27 03:48:10 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:48:08</nova:creationTime>
Nov 27 03:48:10 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:48:10 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:48:10 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:48:10 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:48:10 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:48:10 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:48:10 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:48:10 user nova-compute[75006]:       <nova:owner>
Nov 27 03:48:10 user nova-compute[75006]:         <nova:user uuid="bee3d2a74e8748c1aa045cc93d4894e5">tempest-TestVolumeBootPattern-1716945418-project-member</nova:user>
Nov 27 03:48:10 user nova-compute[75006]:         <nova:project uuid="46b1b7443dc44f21ac89452277f326b1">tempest-TestVolumeBootPattern-1716945418</nova:project>
Nov 27 03:48:10 user nova-compute[75006]:       </nova:owner>
Nov 27 03:48:10 user nova-compute[75006]:       <nova:ports>
Nov 27 03:48:10 user nova-compute[75006]:         <nova:port uuid="684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd">
Nov 27 03:48:10 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 03:48:10 user nova-compute[75006]:         </nova:port>
Nov 27 03:48:10 user nova-compute[75006]:       </nova:ports>
Nov 27 03:48:10 user nova-compute[75006]:     </nova:instance>
Nov 27 03:48:10 user nova-compute[75006]:   </metadata>
Nov 27 03:48:10 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:48:10 user nova-compute[75006]:     <system>
Nov 27 03:48:10 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:48:10 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:48:10 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:48:10 user nova-compute[75006]:       <entry name="serial">46038be1-3a6d-4e48-9053-463d986af885</entry>
Nov 27 03:48:10 user nova-compute[75006]:       <entry name="uuid">46038be1-3a6d-4e48-9053-463d986af885</entry>
Nov 27 03:48:10 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:48:10 user nova-compute[75006]:     </system>
Nov 27 03:48:10 user nova-compute[75006]:   </sysinfo>
Nov 27 03:48:10 user nova-compute[75006]:   <os>
Nov 27 03:48:10 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:48:10 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:48:10 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:48:10 user nova-compute[75006]:   </os>
Nov 27 03:48:10 user nova-compute[75006]:   <features>
Nov 27 03:48:10 user nova-compute[75006]:     <acpi/>
Nov 27 03:48:10 user nova-compute[75006]:     <apic/>
Nov 27 03:48:10 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:48:10 user nova-compute[75006]:   </features>
Nov 27 03:48:10 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:48:10 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:48:10 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:48:10 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:48:10 user nova-compute[75006]:   </clock>
Nov 27 03:48:10 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:48:10 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:48:10 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:48:10 user nova-compute[75006]:   </cpu>
Nov 27 03:48:10 user nova-compute[75006]:   <devices>
Nov 27 03:48:10 user nova-compute[75006]:     <disk type="block" device="disk">
Nov 27 03:48:10 user nova-compute[75006]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:48:10 user nova-compute[75006]:       <source dev="/dev/sdd"/>
Nov 27 03:48:10 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:48:10 user nova-compute[75006]:       <serial>f14f3a50-9479-4ef1-b3ad-d63dd1818222</serial>
Nov 27 03:48:10 user nova-compute[75006]:     </disk>
Nov 27 03:48:10 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:48:10 user nova-compute[75006]:       <mac address="fa:16:3e:b5:66:68"/>
Nov 27 03:48:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:48:10 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:48:10 user nova-compute[75006]:       <target dev="tap684d6aa2-c1"/>
Nov 27 03:48:10 user nova-compute[75006]:     </interface>
Nov 27 03:48:10 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:48:10 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/46038be1-3a6d-4e48-9053-463d986af885/console.log" append="off"/>
Nov 27 03:48:10 user nova-compute[75006]:     </serial>
Nov 27 03:48:10 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:48:10 user nova-compute[75006]:     <video>
Nov 27 03:48:10 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:48:10 user nova-compute[75006]:     </video>
Nov 27 03:48:10 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:48:10 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:48:10 user nova-compute[75006]:     </rng>
Nov 27 03:48:10 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:48:10 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:48:10 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:48:10 user nova-compute[75006]:     </memballoon>
Nov 27 03:48:10 user nova-compute[75006]:   </devices>
Nov 27 03:48:10 user nova-compute[75006]: </domain>
Nov 27 03:48:10 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-169684316',display_name='tempest-TestVolumeBootPattern-server-169684316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-169684316',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-3ub893pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:48:00Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=46038be1-3a6d-4e48-9053-463d986af885,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:66:68,bridge_name='br-int',has_traffic_filtering=True,id=684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap684d6aa2-c1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG os_vif [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:66:68,bridge_name='br-int',has_traffic_filtering=True,id=684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap684d6aa2-c1') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e707b8f-fb2e-54bf-9a53-c5780d827630', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap684d6aa2-c1, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap684d6aa2-c1, col_values=(('qos', UUID('9e9562c8-e8a4-44d9-a133-ea96337aef62')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap684d6aa2-c1, col_values=(('external_ids', {'iface-id': '684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:66:68', 'vm-uuid': '46038be1-3a6d-4e48-9053-463d986af885'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:10 user nova-compute[75006]: INFO os_vif [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:66:68,bridge_name='br-int',has_traffic_filtering=True,id=684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap684d6aa2-c1')
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] No VIF found with MAC fa:16:3e:b5:66:68, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:48:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-c6bf0e8f-433a-4193-b7a6-be10494916f3 req-8436b267-761c-4ed3-acd0-3fa1999033a6 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c6bf0e8f-433a-4193-b7a6-be10494916f3 req-8436b267-761c-4ed3-acd0-3fa1999033a6 service nova] Acquiring lock "46038be1-3a6d-4e48-9053-463d986af885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c6bf0e8f-433a-4193-b7a6-be10494916f3 req-8436b267-761c-4ed3-acd0-3fa1999033a6 service nova] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c6bf0e8f-433a-4193-b7a6-be10494916f3 req-8436b267-761c-4ed3-acd0-3fa1999033a6 service nova] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG nova.compute.manager [req-c6bf0e8f-433a-4193-b7a6-be10494916f3 req-8436b267-761c-4ed3-acd0-3fa1999033a6 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] No waiting events found dispatching network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:48:11 user nova-compute[75006]: WARNING nova.compute.manager [req-c6bf0e8f-433a-4193-b7a6-be10494916f3 req-8436b267-761c-4ed3-acd0-3fa1999033a6 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received unexpected event network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd for instance with vm_state building and task_state spawning.
Nov 27 03:48:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:12 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 is timed out.
Nov 27 03:48:12 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully detached device vdb from instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 from the live domain config.
Nov 27 03:48:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLTUeBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:48:12 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc54570-a5be-4e90-af29-1c1994d55719]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:48:12 user nova-compute[75006]: No targets found.
Nov 27 03:48:12 user nova-compute[75006]: iSNS:
Nov 27 03:48:12 user nova-compute[75006]: No targets found.
Nov 27 03:48:12 user nova-compute[75006]: STATIC:
Nov 27 03:48:12 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222
Nov 27 03:48:12 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:48:12 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:48:12 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2
Nov 27 03:48:12 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:48:12 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:48:12 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:48:12 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:48:12 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:48:12 user nova-compute[75006]: FIRMWARE:
Nov 27 03:48:12 user nova-compute[75006]: No targets found.
Nov 27 03:48:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:48:12 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:48:12 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad23e2e2-9408-423b-a9b2-ad1c835c95c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d698f-b5f7-4341-baf7-b492bc454381]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:48:12 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:12 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 (non-flash)
Nov 27 03:48:12 user nova-compute[75006]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:12 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd400596dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4f085-08ff-4577-ad97-65fec5f2a8f9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[227d3220-4b66-4751-a865-98ce2f1ad689]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75fe57d-eb18-4ef0-ac38-d16ef3d9848f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ae2178-9069-4de2-9375-01d21f3d9356]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc6cd49-2765-4d1d-b7dd-b4e906956fa2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc08e8e8-b2d0-4fe0-9bfc-9d87664e6ce8]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260]
Nov 27 03:48:12 user nova-compute[75006]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2, portal: 172.16.0.220,3260] successful.
Nov 27 03:48:12 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64b45680-4d23-477d-b9e6-58fbc673e9a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feae952-8192-4568-a003-d3c9120bc7f7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] <== disconnect_volume: return (293ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:12 user nova-compute[75006]: INFO nova.compute.manager [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attaching volume 0794f86e-9915-4ebf-9332-0d424abfdd01 to /dev/vdb
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.utils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9933343f-f4f8-4bb9-8723-2ba49a0b8958]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0739a590-e5b3-4e72-8ae0-e62a225f37c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3d9f30-44c3-436c-b7e4-52008f3d1ff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f73d267-b8de-4c57-ad2e-d89e1912548f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:48:12 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:48:12 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae417b9c-3df6-4328-9509-09f162f9cd42]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG os_brick.utils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:48:12 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating existing volume attachment record: a77a4ebf-e898-4700-85bd-4acee349667f {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.objects.instance [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'flavor' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-fc6cc3d2-cb18-48cf-9914-116d7b4c1de8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:48:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Instance spawned successfully.
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:48:13 user nova-compute[75006]: INFO nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-5082d2bb-5b1f-4467-8237-e7ef82f7daec req-3af8cf41-8f41-4c91-afc6-df58a201463e service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5082d2bb-5b1f-4467-8237-e7ef82f7daec req-3af8cf41-8f41-4c91-afc6-df58a201463e service nova] Acquiring lock "46038be1-3a6d-4e48-9053-463d986af885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5082d2bb-5b1f-4467-8237-e7ef82f7daec req-3af8cf41-8f41-4c91-afc6-df58a201463e service nova] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-5082d2bb-5b1f-4467-8237-e7ef82f7daec req-3af8cf41-8f41-4c91-afc6-df58a201463e service nova] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.compute.manager [req-5082d2bb-5b1f-4467-8237-e7ef82f7daec req-3af8cf41-8f41-4c91-afc6-df58a201463e service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] No waiting events found dispatching network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:48:13 user nova-compute[75006]: WARNING nova.compute.manager [req-5082d2bb-5b1f-4467-8237-e7ef82f7daec req-3af8cf41-8f41-4c91-afc6-df58a201463e service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received unexpected event network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd for instance with vm_state building and task_state spawning.
Nov 27 03:48:13 user nova-compute[75006]: INFO nova.compute.manager [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Took 13.96 seconds to build instance.
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-b61fe9c7-7494-4106-8306-e964cc00df9d tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "46038be1-3a6d-4e48-9053-463d986af885" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.087s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:48:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:48:15 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:48:15 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8585MB free_disk=25.1036376953125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c714a10b-bf0a-4817-986c-6a9474166aff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cf5ef78b-2044-44ed-8553-b2495bee68d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 46038be1-3a6d-4e48-9053-463d986af885 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:18 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:18 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwleumZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:48:19 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:48:19 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:48:19 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288be34-a167-41c9-9af3-25d2bcc651b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:48:19 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd9ba8-99cb-4a9a-9239-aa3706adfa67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01] added
Nov 27 03:48:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4110e823-9750-4851-a5c6-e24ee23912e3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f4c6e-b849-4855-9eed-4b954bba8c34]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwleumZi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwleumZi" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b67fed2-8f89-44df-9913-fd681c76a371]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwleumZi'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[33db848c-125f-4f69-a806-d7020b0f25f3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[955d7bd3-b576-4f1b-b8ad-28ee3e504ada]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad64940-f32b-4376-b8da-767c75d39b51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01, portal: 172.16.0.220,3260]
Nov 27 03:48:19 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01, portal: 172.16.0.220,3260] successful.
Nov 27 03:48:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b54003c-0510-435b-aa1d-e181466bea5c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[15861f14-1c56-425f-92e1-271779825eb9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 (non-flash)
Nov 27 03:48:19 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ab7d2c-b5a0-455b-b992-8e25a80d98bc]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:48:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwleumZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23731653664313264', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731653664313264', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG nova.objects.instance [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:48:20 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:48:20 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:48:20 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:48:20 user nova-compute[75006]:   <serial>0794f86e-9915-4ebf-9332-0d424abfdd01</serial>
Nov 27 03:48:20 user nova-compute[75006]: </disk>
Nov 27 03:48:20 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] No VIF found with MAC fa:16:3e:5a:60:82, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:48:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-3c809db1-96d6-46d7-b56e-998b228147ed tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.254s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:23 user nova-compute[75006]: INFO nova.compute.manager [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Detaching volume 0794f86e-9915-4ebf-9332-0d424abfdd01
Nov 27 03:48:23 user nova-compute[75006]: INFO nova.virt.block_device [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Attempting to driver detach volume 0794f86e-9915-4ebf-9332-0d424abfdd01 from mountpoint /dev/vdb
Nov 27 03:48:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Attempting to detach device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:48:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:48:23 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:48:23 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:48:23 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:48:23 user nova-compute[75006]:   <serial>0794f86e-9915-4ebf-9332-0d424abfdd01</serial>
Nov 27 03:48:23 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:48:23 user nova-compute[75006]: </disk>
Nov 27 03:48:23 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:48:23 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully detached device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the persistent domain config.
Nov 27 03:48:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c714a10b-bf0a-4817-986c-6a9474166aff from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:48:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:48:23 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:48:23 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:48:23 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:48:23 user nova-compute[75006]:   <serial>0794f86e-9915-4ebf-9332-0d424abfdd01</serial>
Nov 27 03:48:23 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:48:23 user nova-compute[75006]: </disk>
Nov 27 03:48:23 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:48:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:48:23 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:43 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c714a10b-bf0a-4817-986c-6a9474166aff is timed out.
Nov 27 03:48:43 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully detached device vdb from instance c714a10b-bf0a-4817-986c-6a9474166aff from the live domain config.
Nov 27 03:48:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwleumZi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:48:43 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[362cea04-e82f-45d9-9f19-f42c797a641c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:48:43 user nova-compute[75006]: No targets found.
Nov 27 03:48:43 user nova-compute[75006]: iSNS:
Nov 27 03:48:43 user nova-compute[75006]: No targets found.
Nov 27 03:48:43 user nova-compute[75006]: STATIC:
Nov 27 03:48:43 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222
Nov 27 03:48:43 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:48:43 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:48:43 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:48:43 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:48:43 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:48:43 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01
Nov 27 03:48:43 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:48:43 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:48:43 user nova-compute[75006]: FIRMWARE:
Nov 27 03:48:43 user nova-compute[75006]: No targets found.
Nov 27 03:48:43 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:48:43 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:48:43 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5105e1c3-0839-4655-8a88-15532c58808e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c8dd81-9b9e-4f47-976a-9091bc80e905]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:43 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:43 user nova-compute[75006]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 (non-flash)
Nov 27 03:48:43 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:48:43 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:48:43 user nova-compute[75006]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 (non-flash)
Nov 27 03:48:43 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd42429c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f449b6-80bf-4e12-a889-574a4ab753f7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26d9500-16c8-40d4-8238-a65c27eeb0ae]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebd1d28-5712-4b78-84c4-15ade910cf57]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b635b7-ecee-4b46-813c-aff037711ebf]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[471286b3-9344-4f23-a4b2-f939e61c0c6a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c7f044-0658-4dba-a74b-f3964cd629aa]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01, portal: 172.16.0.220,3260]
Nov 27 03:48:43 user nova-compute[75006]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01, portal: 172.16.0.220,3260] successful.
Nov 27 03:48:43 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0794f86e-9915-4ebf-9332-0d424abfdd01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[043942e0-027f-4ecc-b319-a4c4e1814d8e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] <== disconnect_volume: return (294ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:48:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:48:44 user nova-compute[75006]: DEBUG nova.objects.instance [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'flavor' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:48:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-50138f74-3c90-4ee0-8f8e-641da024400a tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.670s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:45 user nova-compute[75006]: INFO nova.compute.manager [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Terminating instance
Nov 27 03:48:45 user nova-compute[75006]: DEBUG nova.compute.manager [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-3a9aa5b7-cdbc-49b7-b2c0-f99b1fc14089 req-2fb4039b-88de-422c-8bb4-25d7fc304f41 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-unplugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3a9aa5b7-cdbc-49b7-b2c0-f99b1fc14089 req-2fb4039b-88de-422c-8bb4-25d7fc304f41 service nova] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3a9aa5b7-cdbc-49b7-b2c0-f99b1fc14089 req-2fb4039b-88de-422c-8bb4-25d7fc304f41 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3a9aa5b7-cdbc-49b7-b2c0-f99b1fc14089 req-2fb4039b-88de-422c-8bb4-25d7fc304f41 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-3a9aa5b7-cdbc-49b7-b2c0-f99b1fc14089 req-2fb4039b-88de-422c-8bb4-25d7fc304f41 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] No waiting events found dispatching network-vif-unplugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG nova.compute.manager [req-3a9aa5b7-cdbc-49b7-b2c0-f99b1fc14089 req-2fb4039b-88de-422c-8bb4-25d7fc304f41 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-unplugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:46 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Instance destroyed successfully.
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.objects.instance [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'resources' on Instance uuid 3fc62fa4-b1dc-4e19-8a94-46ce222cde28 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:43:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-828253563',display_name='tempest-TestMinimumBasicScenario-server-828253563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-828253563',id=49,image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlrjdH7fytl3Xmar+pijwVOFUpYZbaCcomOMdkgvKJP9pNIMsOuCpVrw60q0QosiHQ/33xAvTCX0LQhPZHfdanCcAEW/2vo8ts4iYhBus9H/2GXMUZ9ZNJn7q3WAHs42g==',key_name='tempest-TestMinimumBasicScenario-1574990255',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-tbvahw6n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b9baa0d2-2a66-4cf4-ae90-da4b4d8e27bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:46:06Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=3fc62fa4-b1dc-4e19-8a94-46ce222cde28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "address": "fa:16:3e:87:fe:9d", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35dda302-74", "ovs_interfaceid": "35dda302-74eb-4b3f-9cdb-55d82cdc4e16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG os_vif [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35dda302-74, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14d91171-78c6-4f70-8a3e-102eff34fd32) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:46 user nova-compute[75006]: INFO os_vif [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:fe:9d,bridge_name='br-int',has_traffic_filtering=True,id=35dda302-74eb-4b3f-9cdb-55d82cdc4e16,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35dda302-74')
Nov 27 03:48:46 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Deleting instance files /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28_del
Nov 27 03:48:46 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Deletion of /opt/stack/data/nova/instances/3fc62fa4-b1dc-4e19-8a94-46ce222cde28_del complete
Nov 27 03:48:46 user nova-compute[75006]: INFO nova.compute.manager [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 27 03:48:46 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:48:46 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Took 0.44 seconds to deallocate network for instance.
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-44881309-45c9-431a-b1f4-1eb19e8e1c99 req-80b0fd74-effc-4557-92e8-26fc1f6f5b48 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-deleted-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:48:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:46 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Deleted allocations for instance 3fc62fa4-b1dc-4e19-8a94-46ce222cde28
Nov 27 03:48:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-9bf29909-9250-46b0-bcba-0a360207d482 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.701s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-72084d6d-86f5-4305-a5d3-1d30210ffdf8 req-e033c54e-b138-4395-b319-fac0fd9c8615 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:48:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72084d6d-86f5-4305-a5d3-1d30210ffdf8 req-e033c54e-b138-4395-b319-fac0fd9c8615 service nova] Acquiring lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:48:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72084d6d-86f5-4305-a5d3-1d30210ffdf8 req-e033c54e-b138-4395-b319-fac0fd9c8615 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:48:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-72084d6d-86f5-4305-a5d3-1d30210ffdf8 req-e033c54e-b138-4395-b319-fac0fd9c8615 service nova] Lock "3fc62fa4-b1dc-4e19-8a94-46ce222cde28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:48:47 user nova-compute[75006]: DEBUG nova.compute.manager [req-72084d6d-86f5-4305-a5d3-1d30210ffdf8 req-e033c54e-b138-4395-b319-fac0fd9c8615 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] No waiting events found dispatching network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:48:47 user nova-compute[75006]: WARNING nova.compute.manager [req-72084d6d-86f5-4305-a5d3-1d30210ffdf8 req-e033c54e-b138-4395-b319-fac0fd9c8615 service nova] [instance: 3fc62fa4-b1dc-4e19-8a94-46ce222cde28] Received unexpected event network-vif-plugged-35dda302-74eb-4b3f-9cdb-55d82cdc4e16 for instance with vm_state deleted and task_state None.
Nov 27 03:48:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:48:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:49:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:49:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:49:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:49:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:49:09 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:49:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating instance_info_cache with network_info: [{"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:49:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-c714a10b-bf0a-4817-986c-6a9474166aff" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:49:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:49:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:49:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:49:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:49:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:11 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:49:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:49:15 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:49:15 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8678MB free_disk=25.121055603027344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance c714a10b-bf0a-4817-986c-6a9474166aff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cf5ef78b-2044-44ed-8553-b2495bee68d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance 46038be1-3a6d-4e48-9053-463d986af885 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:49:15 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:49:16 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:49:16 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:49:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:16 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:49:16 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:49:16 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:49:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:49:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:49:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:49:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:24 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:24 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:49:24 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:49:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:36 user nova-compute[75006]: INFO nova.compute.manager [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Terminating instance
Nov 27 03:49:36 user nova-compute[75006]: DEBUG nova.compute.manager [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-4ca3710c-806f-49e9-bb6a-ea145a72196d req-59d1d1e3-e4d9-492b-a56f-bdcee0af5156 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-unplugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4ca3710c-806f-49e9-bb6a-ea145a72196d req-59d1d1e3-e4d9-492b-a56f-bdcee0af5156 service nova] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4ca3710c-806f-49e9-bb6a-ea145a72196d req-59d1d1e3-e4d9-492b-a56f-bdcee0af5156 service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4ca3710c-806f-49e9-bb6a-ea145a72196d req-59d1d1e3-e4d9-492b-a56f-bdcee0af5156 service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-4ca3710c-806f-49e9-bb6a-ea145a72196d req-59d1d1e3-e4d9-492b-a56f-bdcee0af5156 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] No waiting events found dispatching network-vif-unplugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG nova.compute.manager [req-4ca3710c-806f-49e9-bb6a-ea145a72196d req-59d1d1e3-e4d9-492b-a56f-bdcee0af5156 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-unplugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Instance destroyed successfully.
Nov 27 03:49:37 user nova-compute[75006]: DEBUG nova.objects.instance [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lazy-loading 'resources' on Instance uuid c714a10b-bf0a-4817-986c-6a9474166aff {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:42:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1486231319',display_name='tempest-SnapshotDataIntegrityTests-server-1486231319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1486231319',id=47,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/I9haFcMLOgphf8l1taUWSQddxrAXoZky7h3SKv1kqeuQJMWW94Lnv+mXCe4W5ewy7hmcwQ5f1aGF1ezuSJjJz/6c3AAKi3FA2ZbG6Vd1jvByUh0pTWwcNtsaN03d3Fg==',key_name='tempest-keypair-596794712',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eee74a64f09422ab25975e29d9d230a',ramdisk_id='',reservation_id='r-64lql6ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-60723552',owner_user_name='tempest-SnapshotDataIntegrityTests-60723552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:43:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='09d37e9688a64fe8b60191b5243a1c20',uuid=c714a10b-bf0a-4817-986c-6a9474166aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Converting VIF {"id": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "address": "fa:16:3e:5a:60:82", "network": {"id": "47f5e6c5-de61-44b8-a4d7-c24acda04de3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1012531183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eee74a64f09422ab25975e29d9d230a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e7d4021-4b", "ovs_interfaceid": "1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:60:82,bridge_name='br-int',has_traffic_filtering=True,id=1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb,network=Network(47f5e6c5-de61-44b8-a4d7-c24acda04de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7d4021-4b') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG os_vif [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:60:82,bridge_name='br-int',has_traffic_filtering=True,id=1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb,network=Network(47f5e6c5-de61-44b8-a4d7-c24acda04de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7d4021-4b') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e7d4021-4b, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8143747-dfb4-4745-a11b-b8a3c8ebc361) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: INFO os_vif [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:60:82,bridge_name='br-int',has_traffic_filtering=True,id=1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb,network=Network(47f5e6c5-de61-44b8-a4d7-c24acda04de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e7d4021-4b')
Nov 27 03:49:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Deleting instance files /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff_del
Nov 27 03:49:37 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Deletion of /opt/stack/data/nova/instances/c714a10b-bf0a-4817-986c-6a9474166aff_del complete
Nov 27 03:49:37 user nova-compute[75006]: INFO nova.compute.manager [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 03:49:37 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:49:38 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Took 0.87 seconds to deallocate network for instance.
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-cf15795a-9864-4fad-80eb-7ed30fca2186 req-89bd5d33-7ce6-422b-8559-5b923cd90d39 service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-deleted-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:38 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Deleted allocations for instance c714a10b-bf0a-4817-986c-6a9474166aff
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d72f60cf-927b-4f9f-8eb1-68d686c9a0ab tempest-SnapshotDataIntegrityTests-60723552 tempest-SnapshotDataIntegrityTests-60723552-project-member] Lock "c714a10b-bf0a-4817-986c-6a9474166aff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] No waiting events found dispatching network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:38 user nova-compute[75006]: WARNING nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received unexpected event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb for instance with vm_state deleted and task_state None.
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] No waiting events found dispatching network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:38 user nova-compute[75006]: WARNING nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received unexpected event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb for instance with vm_state deleted and task_state None.
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] No waiting events found dispatching network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:38 user nova-compute[75006]: WARNING nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received unexpected event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb for instance with vm_state deleted and task_state None.
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-unplugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] No waiting events found dispatching network-vif-unplugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:38 user nova-compute[75006]: WARNING nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received unexpected event network-vif-unplugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb for instance with vm_state deleted and task_state None.
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Acquiring lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] Lock "c714a10b-bf0a-4817-986c-6a9474166aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] No waiting events found dispatching network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:38 user nova-compute[75006]: WARNING nova.compute.manager [req-6a1e6651-b921-4d6d-a131-45c5c2ee962d req-f0338830-ae6b-495d-89f7-b62f0b588e3b service nova] [instance: c714a10b-bf0a-4817-986c-6a9474166aff] Received unexpected event network-vif-plugged-1e7d4021-4b8c-4bf1-9fe4-5615664d6dcb for instance with vm_state deleted and task_state None.
Nov 27 03:49:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:39 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:49:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:39 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:49:39 user nova-compute[75006]: INFO nova.compute.claims [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Claim successful on node user
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:49:40 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.policy [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3aa8e6a955544d2a360cc6c757d9768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547df17332884139955057bf12619e4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:49:40 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Creating image(s)
Nov 27 03:49:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "/opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "/opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "961b623b98ad683eadd1655bd3416efe02b866ad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:40 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "961b623b98ad683eadd1655bd3416efe02b866ad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad.part --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad.part --force-share --output=json" returned: 0 in 0.310s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:41 user nova-compute[75006]: DEBUG nova.virt.images [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] 19210244-b363-449a-b38c-be7439b56d33 was qcow2, converting to raw {{(pid=75006) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 03:49:41 user nova-compute[75006]: DEBUG nova.privsep.utils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75006) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 03:49:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad.part /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad.converted {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:41 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Successfully created port: f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:49:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad.part /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad.converted" returned: 0 in 0.511s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:41 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad.converted --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "961b623b98ad683eadd1655bd3416efe02b866ad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.695s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Successfully updated port: f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad --force-share --output=json" returned: 0 in 0.176s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "961b623b98ad683eadd1655bd3416efe02b866ad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "961b623b98ad683eadd1655bd3416efe02b866ad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-f466d0f1-7837-419e-878f-2eea16b5f51c req-12a748ff-b1f6-430b-9f28-363f2495cfdc service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.compute.manager [req-f466d0f1-7837-419e-878f-2eea16b5f51c req-12a748ff-b1f6-430b-9f28-363f2495cfdc service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing instance network info cache due to event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f466d0f1-7837-419e-878f-2eea16b5f51c req-12a748ff-b1f6-430b-9f28-363f2495cfdc service nova] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f466d0f1-7837-419e-878f-2eea16b5f51c req-12a748ff-b1f6-430b-9f28-363f2495cfdc service nova] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-f466d0f1-7837-419e-878f-2eea16b5f51c req-12a748ff-b1f6-430b-9f28-363f2495cfdc service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-f466d0f1-7837-419e-878f-2eea16b5f51c req-12a748ff-b1f6-430b-9f28-363f2495cfdc service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad,backing_fmt=raw /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad,backing_fmt=raw /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk 1073741824" returned: 0 in 0.083s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "961b623b98ad683eadd1655bd3416efe02b866ad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.network.neutron [req-f466d0f1-7837-419e-878f-2eea16b5f51c req-12a748ff-b1f6-430b-9f28-363f2495cfdc service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f466d0f1-7837-419e-878f-2eea16b5f51c req-12a748ff-b1f6-430b-9f28-363f2495cfdc service nova] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Cannot resize image /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Ensure instance console log exists: /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.network.neutron [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance network_info: |[{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Start _get_guest_xml network_info=[{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:49:37Z,direct_url=<?>,disk_format='qcow2',id=19210244-b363-449a-b38c-be7439b56d33,min_disk=0,min_ram=0,name='tempest-scenario-img--1154855915',owner='547df17332884139955057bf12619e4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:49:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '19210244-b363-449a-b38c-be7439b56d33'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:49:42 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:49:42 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:49:37Z,direct_url=<?>,disk_format='qcow2',id=19210244-b363-449a-b38c-be7439b56d33,min_disk=0,min_ram=0,name='tempest-scenario-img--1154855915',owner='547df17332884139955057bf12619e4d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:49:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:49:42 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1730237124',display_name='tempest-TestMinimumBasicScenario-server-1730237124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1730237124',id=52,image_ref='19210244-b363-449a-b38c-be7439b56d33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpAZedwUlaUsLALtawwWqthGY/29DdQNPRdr2fz9wg3GUTG3/WQieCKhMQxcbDue586pTit7Zlr5GxoS9X3dXKUjq5I2eGQWa8pKfppBXLO/968xPeb3ZkulBu56VNPHA==',key_name='tempest-TestMinimumBasicScenario-1641280722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-ip7sfv07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='19210244-b363-449a-b38c-be7439b56d33',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:49:40Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=ec150b17-d8e5-457d-ba4a-7d85b4975e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:6e:74,bridge_name='br-int',has_traffic_filtering=True,id=f67a307d-3316-47d3-bfbe-451006aeb028,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf67a307d-33') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.objects.instance [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'pci_devices' on Instance uuid ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:49:43 user nova-compute[75006]:   <uuid>ec150b17-d8e5-457d-ba4a-7d85b4975e42</uuid>
Nov 27 03:49:43 user nova-compute[75006]:   <name>instance-00000034</name>
Nov 27 03:49:43 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:49:43 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:49:43 user nova-compute[75006]:   <metadata>
Nov 27 03:49:43 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:49:43 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:49:43 user nova-compute[75006]:       <nova:name>tempest-TestMinimumBasicScenario-server-1730237124</nova:name>
Nov 27 03:49:43 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:49:42</nova:creationTime>
Nov 27 03:49:43 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:49:43 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:49:43 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:49:43 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:49:43 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:49:43 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:49:43 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:49:43 user nova-compute[75006]:       <nova:owner>
Nov 27 03:49:43 user nova-compute[75006]:         <nova:user uuid="e3aa8e6a955544d2a360cc6c757d9768">tempest-TestMinimumBasicScenario-1813903653-project-member</nova:user>
Nov 27 03:49:43 user nova-compute[75006]:         <nova:project uuid="547df17332884139955057bf12619e4d">tempest-TestMinimumBasicScenario-1813903653</nova:project>
Nov 27 03:49:43 user nova-compute[75006]:       </nova:owner>
Nov 27 03:49:43 user nova-compute[75006]:       <nova:root type="image" uuid="19210244-b363-449a-b38c-be7439b56d33"/>
Nov 27 03:49:43 user nova-compute[75006]:       <nova:ports>
Nov 27 03:49:43 user nova-compute[75006]:         <nova:port uuid="f67a307d-3316-47d3-bfbe-451006aeb028">
Nov 27 03:49:43 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 03:49:43 user nova-compute[75006]:         </nova:port>
Nov 27 03:49:43 user nova-compute[75006]:       </nova:ports>
Nov 27 03:49:43 user nova-compute[75006]:     </nova:instance>
Nov 27 03:49:43 user nova-compute[75006]:   </metadata>
Nov 27 03:49:43 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:49:43 user nova-compute[75006]:     <system>
Nov 27 03:49:43 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:49:43 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:49:43 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:49:43 user nova-compute[75006]:       <entry name="serial">ec150b17-d8e5-457d-ba4a-7d85b4975e42</entry>
Nov 27 03:49:43 user nova-compute[75006]:       <entry name="uuid">ec150b17-d8e5-457d-ba4a-7d85b4975e42</entry>
Nov 27 03:49:43 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:49:43 user nova-compute[75006]:     </system>
Nov 27 03:49:43 user nova-compute[75006]:   </sysinfo>
Nov 27 03:49:43 user nova-compute[75006]:   <os>
Nov 27 03:49:43 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:49:43 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:49:43 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:49:43 user nova-compute[75006]:   </os>
Nov 27 03:49:43 user nova-compute[75006]:   <features>
Nov 27 03:49:43 user nova-compute[75006]:     <acpi/>
Nov 27 03:49:43 user nova-compute[75006]:     <apic/>
Nov 27 03:49:43 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:49:43 user nova-compute[75006]:   </features>
Nov 27 03:49:43 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:49:43 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:49:43 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:49:43 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:49:43 user nova-compute[75006]:   </clock>
Nov 27 03:49:43 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:49:43 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:49:43 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:49:43 user nova-compute[75006]:   </cpu>
Nov 27 03:49:43 user nova-compute[75006]:   <devices>
Nov 27 03:49:43 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:49:43 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:49:43 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk"/>
Nov 27 03:49:43 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:49:43 user nova-compute[75006]:     </disk>
Nov 27 03:49:43 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:49:43 user nova-compute[75006]:       <mac address="fa:16:3e:e9:6e:74"/>
Nov 27 03:49:43 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:49:43 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:49:43 user nova-compute[75006]:       <target dev="tapf67a307d-33"/>
Nov 27 03:49:43 user nova-compute[75006]:     </interface>
Nov 27 03:49:43 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:49:43 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/console.log" append="off"/>
Nov 27 03:49:43 user nova-compute[75006]:     </serial>
Nov 27 03:49:43 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:49:43 user nova-compute[75006]:     <video>
Nov 27 03:49:43 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:49:43 user nova-compute[75006]:     </video>
Nov 27 03:49:43 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:49:43 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:49:43 user nova-compute[75006]:     </rng>
Nov 27 03:49:43 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:49:43 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:49:43 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:49:43 user nova-compute[75006]:     </memballoon>
Nov 27 03:49:43 user nova-compute[75006]:   </devices>
Nov 27 03:49:43 user nova-compute[75006]: </domain>
Nov 27 03:49:43 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1730237124',display_name='tempest-TestMinimumBasicScenario-server-1730237124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1730237124',id=52,image_ref='19210244-b363-449a-b38c-be7439b56d33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpAZedwUlaUsLALtawwWqthGY/29DdQNPRdr2fz9wg3GUTG3/WQieCKhMQxcbDue586pTit7Zlr5GxoS9X3dXKUjq5I2eGQWa8pKfppBXLO/968xPeb3ZkulBu56VNPHA==',key_name='tempest-TestMinimumBasicScenario-1641280722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-ip7sfv07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='19210244-b363-449a-b38c-be7439b56d33',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:49:40Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=ec150b17-d8e5-457d-ba4a-7d85b4975e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:6e:74,bridge_name='br-int',has_traffic_filtering=True,id=f67a307d-3316-47d3-bfbe-451006aeb028,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf67a307d-33') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG os_vif [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:6e:74,bridge_name='br-int',has_traffic_filtering=True,id=f67a307d-3316-47d3-bfbe-451006aeb028,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf67a307d-33') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad2b44e8-971e-5bb5-9745-1c3750124551', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf67a307d-33, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf67a307d-33, col_values=(('qos', UUID('7427ac33-5128-4a2b-a1cb-b7506566e4b3')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf67a307d-33, col_values=(('external_ids', {'iface-id': 'f67a307d-3316-47d3-bfbe-451006aeb028', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:6e:74', 'vm-uuid': 'ec150b17-d8e5-457d-ba4a-7d85b4975e42'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:43 user nova-compute[75006]: INFO os_vif [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:6e:74,bridge_name='br-int',has_traffic_filtering=True,id=f67a307d-3316-47d3-bfbe-451006aeb028,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf67a307d-33')
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:49:43 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No VIF found with MAC fa:16:3e:e9:6e:74, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-a249a87d-3d45-472f-9e0d-bd79807af4ea req-25c00a84-20fe-489f-b299-bff82ac0fe15 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a249a87d-3d45-472f-9e0d-bd79807af4ea req-25c00a84-20fe-489f-b299-bff82ac0fe15 service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a249a87d-3d45-472f-9e0d-bd79807af4ea req-25c00a84-20fe-489f-b299-bff82ac0fe15 service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a249a87d-3d45-472f-9e0d-bd79807af4ea req-25c00a84-20fe-489f-b299-bff82ac0fe15 service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-a249a87d-3d45-472f-9e0d-bd79807af4ea req-25c00a84-20fe-489f-b299-bff82ac0fe15 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:44 user nova-compute[75006]: WARNING nova.compute.manager [req-a249a87d-3d45-472f-9e0d-bd79807af4ea req-25c00a84-20fe-489f-b299-bff82ac0fe15 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state building and task_state spawning.
Nov 27 03:49:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:49:46 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance spawned successfully.
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-1f839d07-565a-4283-8319-cdc3487d9dda req-815bfd01-b52b-4eca-a601-98f4b526b2a5 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1f839d07-565a-4283-8319-cdc3487d9dda req-815bfd01-b52b-4eca-a601-98f4b526b2a5 service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1f839d07-565a-4283-8319-cdc3487d9dda req-815bfd01-b52b-4eca-a601-98f4b526b2a5 service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1f839d07-565a-4283-8319-cdc3487d9dda req-815bfd01-b52b-4eca-a601-98f4b526b2a5 service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-1f839d07-565a-4283-8319-cdc3487d9dda req-815bfd01-b52b-4eca-a601-98f4b526b2a5 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:46 user nova-compute[75006]: WARNING nova.compute.manager [req-1f839d07-565a-4283-8319-cdc3487d9dda req-815bfd01-b52b-4eca-a601-98f4b526b2a5 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state building and task_state spawning.
Nov 27 03:49:46 user nova-compute[75006]: INFO nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 27 03:49:46 user nova-compute[75006]: DEBUG nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:49:46 user nova-compute[75006]: INFO nova.compute.manager [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Took 6.80 seconds to build instance.
Nov 27 03:49:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-a4cf6538-edab-49ea-a13a-72a157222ca7 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.070s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-94dad8d2-3997-4a54-aed5-4813238ffc4a req-8925151b-dabc-496f-a742-5154b520e4d4 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-changed-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:51 user nova-compute[75006]: DEBUG nova.compute.manager [req-94dad8d2-3997-4a54-aed5-4813238ffc4a req-8925151b-dabc-496f-a742-5154b520e4d4 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Refreshing instance network info cache due to event network-changed-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:49:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-94dad8d2-3997-4a54-aed5-4813238ffc4a req-8925151b-dabc-496f-a742-5154b520e4d4 service nova] Acquiring lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:49:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-94dad8d2-3997-4a54-aed5-4813238ffc4a req-8925151b-dabc-496f-a742-5154b520e4d4 service nova] Acquired lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:49:51 user nova-compute[75006]: DEBUG nova.network.neutron [req-94dad8d2-3997-4a54-aed5-4813238ffc4a req-8925151b-dabc-496f-a742-5154b520e4d4 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Refreshing network info cache for port 684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-f9d3d896-c734-447e-ae84-42ffbe80acf9 req-10da0165-b988-4e2c-8823-aae8a97188f3 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-changed-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-f9d3d896-c734-447e-ae84-42ffbe80acf9 req-10da0165-b988-4e2c-8823-aae8a97188f3 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Refreshing instance network info cache due to event network-changed-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f9d3d896-c734-447e-ae84-42ffbe80acf9 req-10da0165-b988-4e2c-8823-aae8a97188f3 service nova] Acquiring lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "46038be1-3a6d-4e48-9053-463d986af885" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "46038be1-3a6d-4e48-9053-463d986af885" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "46038be1-3a6d-4e48-9053-463d986af885-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:52 user nova-compute[75006]: INFO nova.compute.manager [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Terminating instance
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-94dad8d2-3997-4a54-aed5-4813238ffc4a req-8925151b-dabc-496f-a742-5154b520e4d4 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updated VIF entry in instance network info cache for port 684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-94dad8d2-3997-4a54-aed5-4813238ffc4a req-8925151b-dabc-496f-a742-5154b520e4d4 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updating instance_info_cache with network_info: [{"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.compute.manager [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-94dad8d2-3997-4a54-aed5-4813238ffc4a req-8925151b-dabc-496f-a742-5154b520e4d4 service nova] Releasing lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f9d3d896-c734-447e-ae84-42ffbe80acf9 req-10da0165-b988-4e2c-8823-aae8a97188f3 service nova] Acquired lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-f9d3d896-c734-447e-ae84-42ffbe80acf9 req-10da0165-b988-4e2c-8823-aae8a97188f3 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Refreshing network info cache for port 684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-a4f07042-b3ca-4336-9c8c-fb04749b4725 req-3080bbd6-0b84-4a32-93a6-079227a5253b service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-vif-unplugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a4f07042-b3ca-4336-9c8c-fb04749b4725 req-3080bbd6-0b84-4a32-93a6-079227a5253b service nova] Acquiring lock "46038be1-3a6d-4e48-9053-463d986af885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a4f07042-b3ca-4336-9c8c-fb04749b4725 req-3080bbd6-0b84-4a32-93a6-079227a5253b service nova] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-a4f07042-b3ca-4336-9c8c-fb04749b4725 req-3080bbd6-0b84-4a32-93a6-079227a5253b service nova] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-a4f07042-b3ca-4336-9c8c-fb04749b4725 req-3080bbd6-0b84-4a32-93a6-079227a5253b service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] No waiting events found dispatching network-vif-unplugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-a4f07042-b3ca-4336-9c8c-fb04749b4725 req-3080bbd6-0b84-4a32-93a6-079227a5253b service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-vif-unplugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-f9d3d896-c734-447e-ae84-42ffbe80acf9 req-10da0165-b988-4e2c-8823-aae8a97188f3 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updated VIF entry in instance network info cache for port 684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.network.neutron [req-f9d3d896-c734-447e-ae84-42ffbe80acf9 req-10da0165-b988-4e2c-8823-aae8a97188f3 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updating instance_info_cache with network_info: [{"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f9d3d896-c734-447e-ae84-42ffbe80acf9 req-10da0165-b988-4e2c-8823-aae8a97188f3 service nova] Releasing lock "refresh_cache-46038be1-3a6d-4e48-9053-463d986af885" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:49:52 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Instance destroyed successfully.
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.objects.instance [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'resources' on Instance uuid 46038be1-3a6d-4e48-9053-463d986af885 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-169684316',display_name='tempest-TestVolumeBootPattern-server-169684316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-169684316',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:48:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-3ub893pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:48:14Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=46038be1-3a6d-4e48-9053-463d986af885,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "address": "fa:16:3e:b5:66:68", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap684d6aa2-c1", "ovs_interfaceid": "684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:66:68,bridge_name='br-int',has_traffic_filtering=True,id=684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap684d6aa2-c1') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG os_vif [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:66:68,bridge_name='br-int',has_traffic_filtering=True,id=684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap684d6aa2-c1') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap684d6aa2-c1, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e9562c8-e8a4-44d9-a133-ea96337aef62) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:49:52 user nova-compute[75006]: INFO os_vif [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:66:68,bridge_name='br-int',has_traffic_filtering=True,id=684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap684d6aa2-c1')
Nov 27 03:49:52 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycjreUOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:49:52 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:49:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:49:52 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cc0df2-3ebb-4f7c-a790-586895b82687]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:49:53 user nova-compute[75006]: No targets found.
Nov 27 03:49:53 user nova-compute[75006]: iSNS:
Nov 27 03:49:53 user nova-compute[75006]: No targets found.
Nov 27 03:49:53 user nova-compute[75006]: STATIC:
Nov 27 03:49:53 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222
Nov 27 03:49:53 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:49:53 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:49:53 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:49:53 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:49:53 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:49:53 user nova-compute[75006]: FIRMWARE:
Nov 27 03:49:53 user nova-compute[75006]: No targets found.
Nov 27 03:49:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:49:53 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:49:53 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[876836cf-3e6b-47cb-92ee-f9c654ac97e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[887b4e9a-513e-405e-bddd-018f8e124f37]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:49:53 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:49:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:49:53 user nova-compute[75006]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 (non-flash)
Nov 27 03:49:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd400594ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222'): ({'sdd'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Removing single pathed devices sdd {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3f3579-ca26-43e3-8d78-fb7708630261]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c11907-59ee-4980-b81f-bc70cf8734e8]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flushing IO for device /dev/sdd {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9a6d21-31bb-4619-b68b-7230ca191dd9]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.086s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[791942ad-35d2-4b0d-aa53-3eb82133e753]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] SCSI volumes sdd have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a3c569-e7a1-491b-937c-31cdae7b173e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c5790b-7b7b-41a0-9864-913bff85dc84]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222, portal: 172.16.0.220,3260]
Nov 27 03:49:53 user nova-compute[75006]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222, portal: 172.16.0.220,3260] successful.
Nov 27 03:49:53 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14f3a50-9479-4ef1-b3ad-d63dd1818222 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9834f-8db2-47b8-bfb1-9c05430a80da]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== disconnect_volume: return (348ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:49:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Deleting instance files /opt/stack/data/nova/instances/46038be1-3a6d-4e48-9053-463d986af885_del
Nov 27 03:49:53 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Deletion of /opt/stack/data/nova/instances/46038be1-3a6d-4e48-9053-463d986af885_del complete
Nov 27 03:49:53 user nova-compute[75006]: INFO nova.compute.manager [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 27 03:49:53 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 46038be1-3a6d-4e48-9053-463d986af885] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:49:53 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:49:53 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Took 0.45 seconds to deallocate network for instance.
Nov 27 03:49:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-201439b2-299d-4b81-ba18-68bb84bb9da4 req-d532e3a2-9f41-48fe-a039-09eaa4130c15 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-201439b2-299d-4b81-ba18-68bb84bb9da4 req-d532e3a2-9f41-48fe-a039-09eaa4130c15 service nova] Acquiring lock "46038be1-3a6d-4e48-9053-463d986af885-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-201439b2-299d-4b81-ba18-68bb84bb9da4 req-d532e3a2-9f41-48fe-a039-09eaa4130c15 service nova] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-201439b2-299d-4b81-ba18-68bb84bb9da4 req-d532e3a2-9f41-48fe-a039-09eaa4130c15 service nova] Lock "46038be1-3a6d-4e48-9053-463d986af885-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-201439b2-299d-4b81-ba18-68bb84bb9da4 req-d532e3a2-9f41-48fe-a039-09eaa4130c15 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] No waiting events found dispatching network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:49:54 user nova-compute[75006]: WARNING nova.compute.manager [req-201439b2-299d-4b81-ba18-68bb84bb9da4 req-d532e3a2-9f41-48fe-a039-09eaa4130c15 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received unexpected event network-vif-plugged-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd for instance with vm_state active and task_state deleting.
Nov 27 03:49:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-201439b2-299d-4b81-ba18-68bb84bb9da4 req-d532e3a2-9f41-48fe-a039-09eaa4130c15 service nova] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Received event network-vif-deleted-684d6aa2-c1e5-4835-8a6e-9df60fb8c7cd {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:49:54 user nova-compute[75006]: INFO nova.compute.manager [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: 46038be1-3a6d-4e48-9053-463d986af885] Took 0.89 seconds to detach 1 volumes for instance.
Nov 27 03:49:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:49:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:49:54 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:49:55 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:49:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:55 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Deleted allocations for instance 46038be1-3a6d-4e48-9053-463d986af885
Nov 27 03:49:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-59bcd568-5ee9-4b76-87a4-6e71d0217b0e tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "46038be1-3a6d-4e48-9053-463d986af885" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.989s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:49:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:49:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:02 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:07 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:07 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:08 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:09 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:50:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:50:09 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:50:09 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:50:10 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updating instance_info_cache with network_info: [{"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:50:10 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:50:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:50:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:12 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:14 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:14 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:50:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:50:15 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:50:15 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8744MB free_disk=25.090145111083984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance cf5ef78b-2044-44ed-8553-b2495bee68d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:50:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:17 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:50:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:50:22 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:27 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:32 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:37 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:42 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:50:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:50:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:50:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:50:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:50:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-4e79be26-3b33-4f39-9e49-ac1a21d67d10 req-c93245eb-0fb1-4db5-ba4a-c4b7454e77f1 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-changed-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:50:49 user nova-compute[75006]: DEBUG nova.compute.manager [req-4e79be26-3b33-4f39-9e49-ac1a21d67d10 req-c93245eb-0fb1-4db5-ba4a-c4b7454e77f1 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Refreshing instance network info cache due to event network-changed-60da19e1-4df8-4fab-9d2a-a5d4010ace63. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:50:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4e79be26-3b33-4f39-9e49-ac1a21d67d10 req-c93245eb-0fb1-4db5-ba4a-c4b7454e77f1 service nova] Acquiring lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:50:49 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4e79be26-3b33-4f39-9e49-ac1a21d67d10 req-c93245eb-0fb1-4db5-ba4a-c4b7454e77f1 service nova] Acquired lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:50:49 user nova-compute[75006]: DEBUG nova.network.neutron [req-4e79be26-3b33-4f39-9e49-ac1a21d67d10 req-c93245eb-0fb1-4db5-ba4a-c4b7454e77f1 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Refreshing network info cache for port 60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:50 user nova-compute[75006]: INFO nova.compute.manager [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Terminating instance
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-92b4def0-bd3c-453c-83c0-76726d092e70 req-eca682a8-3795-4e4a-a890-21687e97e732 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-unplugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-92b4def0-bd3c-453c-83c0-76726d092e70 req-eca682a8-3795-4e4a-a890-21687e97e732 service nova] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-92b4def0-bd3c-453c-83c0-76726d092e70 req-eca682a8-3795-4e4a-a890-21687e97e732 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-92b4def0-bd3c-453c-83c0-76726d092e70 req-eca682a8-3795-4e4a-a890-21687e97e732 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-92b4def0-bd3c-453c-83c0-76726d092e70 req-eca682a8-3795-4e4a-a890-21687e97e732 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] No waiting events found dispatching network-vif-unplugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-92b4def0-bd3c-453c-83c0-76726d092e70 req-eca682a8-3795-4e4a-a890-21687e97e732 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-unplugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-4e79be26-3b33-4f39-9e49-ac1a21d67d10 req-c93245eb-0fb1-4db5-ba4a-c4b7454e77f1 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updated VIF entry in instance network info cache for port 60da19e1-4df8-4fab-9d2a-a5d4010ace63. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.network.neutron [req-4e79be26-3b33-4f39-9e49-ac1a21d67d10 req-c93245eb-0fb1-4db5-ba4a-c4b7454e77f1 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updating instance_info_cache with network_info: [{"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-4e79be26-3b33-4f39-9e49-ac1a21d67d10 req-c93245eb-0fb1-4db5-ba4a-c4b7454e77f1 service nova] Releasing lock "refresh_cache-cf5ef78b-2044-44ed-8553-b2495bee68d8" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Instance destroyed successfully.
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.objects.instance [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lazy-loading 'resources' on Instance uuid cf5ef78b-2044-44ed-8553-b2495bee68d8 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-53405435',display_name='tempest-TestVolumeBootPattern-server-53405435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-53405435',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv+sEW8K9jJrYGpDyaTUBYc1ERb+5wDdDRkQkCt+Qx7b6zKq2r6jDAnEH+J7fD+6XFauWSOgsqkNUuU2rUFSILhKIk7YPNbueFVZIOqT2VGf2eaMEBPUREJYbeeX2okcw==',key_name='tempest-TestVolumeBootPattern-774628072',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46b1b7443dc44f21ac89452277f326b1',ramdisk_id='',reservation_id='r-ildqrebm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716945418',owner_user_name='tempest-TestVolumeBootPattern-1716945418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:46:15Z,user_data=None,user_id='bee3d2a74e8748c1aa045cc93d4894e5',uuid=cf5ef78b-2044-44ed-8553-b2495bee68d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converting VIF {"id": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "address": "fa:16:3e:98:d8:64", "network": {"id": "c68765f9-912b-4610-9405-c5a7d7431556", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1459792080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46b1b7443dc44f21ac89452277f326b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60da19e1-4d", "ovs_interfaceid": "60da19e1-4df8-4fab-9d2a-a5d4010ace63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:d8:64,bridge_name='br-int',has_traffic_filtering=True,id=60da19e1-4df8-4fab-9d2a-a5d4010ace63,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da19e1-4d') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_vif [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:d8:64,bridge_name='br-int',has_traffic_filtering=True,id=60da19e1-4df8-4fab-9d2a-a5d4010ace63,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da19e1-4d') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60da19e1-4d, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a96d5431-0051-4ae1-9076-82ed76ebdd0a) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:50:50 user nova-compute[75006]: INFO os_vif [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:d8:64,bridge_name='br-int',has_traffic_filtering=True,id=60da19e1-4df8-4fab-9d2a-a5d4010ace63,network=Network(c68765f9-912b-4610-9405-c5a7d7431556),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60da19e1-4d')
Nov 27 03:50:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PSuUiYxo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:50:50 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a321dfdf-5440-4d55-9604-0e36f288db36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:50:50 user nova-compute[75006]: No targets found.
Nov 27 03:50:50 user nova-compute[75006]: iSNS:
Nov 27 03:50:50 user nova-compute[75006]: No targets found.
Nov 27 03:50:50 user nova-compute[75006]: STATIC:
Nov 27 03:50:50 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6
Nov 27 03:50:50 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:50:50 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:50:50 user nova-compute[75006]: FIRMWARE:
Nov 27 03:50:50 user nova-compute[75006]: No targets found.
Nov 27 03:50:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:50:50 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:50:50 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33c3c5-633a-46d5-b491-8ec3eb0e8cb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1e16c8-1919-4f33-89db-f6d7b894ef15]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:50:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 (non-flash)
Nov 27 03:50:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4007f7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6'): ({'sdc'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Removing single pathed devices sdc {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b6201c-7ba6-4eec-be99-3b63ca227098]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[643ce880-db83-4f2a-ae76-c0bb4510406b]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Flushing IO for device /dev/sdc {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:50:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19e82d6-65ac-4e33-9edf-415e4b0d1c64]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[af02f3af-63e4-45b9-936d-f64b7dac0761]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] SCSI volumes sdc have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4ef6f991', '/dev/disk/by-id/scsi-1SCST_BIO4ef6f991-5c26acccd115c617', '/dev/disk/by-id/scsi-23563323661636363') {{(pid=85775) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19645b9d-3597-44ef-9129-20133c58d1d1]: (4, None) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4386c81f-fa51-48d7-a7ac-b1cab87df402]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f590c4-7052-4ef2-82fb-fb0a7f693572]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260]
Nov 27 03:50:51 user nova-compute[75006]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6, portal: 172.16.0.220,3260] successful.
Nov 27 03:50:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:371da475-1334-4a40-bab4-5cc71d4f95a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[972992c3-67e6-4057-86b2-a310ba305c7a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] <== disconnect_volume: return (332ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:50:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Deleting instance files /opt/stack/data/nova/instances/cf5ef78b-2044-44ed-8553-b2495bee68d8_del
Nov 27 03:50:51 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Deletion of /opt/stack/data/nova/instances/cf5ef78b-2044-44ed-8553-b2495bee68d8_del complete
Nov 27 03:50:51 user nova-compute[75006]: INFO nova.compute.manager [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 27 03:50:51 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:50:51 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:50:51 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Took 0.63 seconds to deallocate network for instance.
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] No waiting events found dispatching network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:50:52 user nova-compute[75006]: WARNING nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received unexpected event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 for instance with vm_state active and task_state deleting.
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] No waiting events found dispatching network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:50:52 user nova-compute[75006]: WARNING nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received unexpected event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 for instance with vm_state active and task_state deleting.
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] No waiting events found dispatching network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:50:52 user nova-compute[75006]: WARNING nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received unexpected event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 for instance with vm_state active and task_state deleting.
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-unplugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] No waiting events found dispatching network-vif-unplugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-unplugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Acquiring lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] No waiting events found dispatching network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:50:52 user nova-compute[75006]: WARNING nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received unexpected event network-vif-plugged-60da19e1-4df8-4fab-9d2a-a5d4010ace63 for instance with vm_state active and task_state deleting.
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-cfc40e16-c984-4420-8425-00ddc1078c62 req-b8374888-f75b-48e3-8288-e50846c0dfc0 service nova] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Received event network-vif-deleted-60da19e1-4df8-4fab-9d2a-a5d4010ace63 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:50:52 user nova-compute[75006]: INFO nova.compute.manager [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] [instance: cf5ef78b-2044-44ed-8553-b2495bee68d8] Took 0.71 seconds to detach 1 volumes for instance.
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:52 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Deleted allocations for instance cf5ef78b-2044-44ed-8553-b2495bee68d8
Nov 27 03:50:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ea674333-eac0-4f39-a3ba-b394903d4f31 tempest-TestVolumeBootPattern-1716945418 tempest-TestVolumeBootPattern-1716945418-project-member] Lock "cf5ef78b-2044-44ed-8553-b2495bee68d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.872s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:50:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:51:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:51:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:11 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:15 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:15 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:51:15 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:16 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:51:16 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:51:16 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.088275909423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:51:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:51:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:51:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:51:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:51:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:51:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:51:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:51:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'flavor' on Instance uuid ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:33 user nova-compute[75006]: INFO nova.compute.manager [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Attaching volume cc66a308-6faf-4f17-a969-1c3ecca7a0c2 to /dev/vdb
Nov 27 03:51:33 user nova-compute[75006]: DEBUG os_brick.utils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a697c2-90f2-4981-a645-b60444d7e0c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff1296-18cc-4209-873e-ea79ba890b4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af8eceb-35f7-4138-b91e-695b0079f93b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee967e4b-ae6e-454f-ac55-01efab45f260]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:51:33 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:51:33 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[507c898d-5747-4f88-ac53-19670fbee3a3]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG os_brick.utils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:51:33 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating existing volume attachment record: 4bb1564c-4c09-4379-ae4b-6655c7beaf0a {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:51:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:51:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:51:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:51:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZolDQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:51:39 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:51:39 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:51:39 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e66a2-742a-41d0-9234-3add79f015d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:51:39 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b6c4c6-ba42-4288-a9f6-3e1dc2742730]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2] added
Nov 27 03:51:39 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b651575-4a71-4f0c-b726-3445533a93e7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e8e8d6-2f39-45b5-933c-9a09c6c7d884]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMZolDQK {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gMZolDQK" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc8af80-31b8-43d2-a7da-4b87b7547a61]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gMZolDQK'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d8d74-31a4-43dd-82c9-c920b4854399]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[969e39a5-2ffb-43bd-9a00-1574501e9809]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 03:51:39 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 03:51:39 user nova-compute[75006]:  {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:51:39 user nova-compute[75006]: WARNING os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 03:51:39 user nova-compute[75006]: 
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a0cc6-fdb0-4117-9792-60e7ea9b4bc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2, portal: 172.16.0.220,3260]
Nov 27 03:51:39 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2, portal: 172.16.0.220,3260] successful.
Nov 27 03:51:39 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1423746a-874a-4a5f-8a7f-c857a81c13e8]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[23721e97-7192-42e0-8533-8cac8f913af9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 (non-flash)
Nov 27 03:51:39 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 (non-flash)
Nov 27 03:51:39 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[905b8ae4-925c-4f27-a920-624a8f7c07a0]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:51:39 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZolDQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26562666461333533', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562666461333533', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG nova.objects.instance [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'flavor' on Instance uuid ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:51:40 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:51:40 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:51:40 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:51:40 user nova-compute[75006]:   <serial>cc66a308-6faf-4f17-a969-1c3ecca7a0c2</serial>
Nov 27 03:51:40 user nova-compute[75006]: </disk>
Nov 27 03:51:40 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:51:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:51:41 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] No VIF found with MAC fa:16:3e:e9:6e:74, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:51:41 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-176b584b-c678-49f0-8ef8-1bfceafe42d8 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.665s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-64747663-b88a-4564-b507-76b6d492b77f req-f746b05c-37e1-4d74-a8d0-cf2529fa292e service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:51:44 user nova-compute[75006]: DEBUG nova.compute.manager [req-64747663-b88a-4564-b507-76b6d492b77f req-f746b05c-37e1-4d74-a8d0-cf2529fa292e service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing instance network info cache due to event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:51:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-64747663-b88a-4564-b507-76b6d492b77f req-f746b05c-37e1-4d74-a8d0-cf2529fa292e service nova] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:51:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-64747663-b88a-4564-b507-76b6d492b77f req-f746b05c-37e1-4d74-a8d0-cf2529fa292e service nova] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:51:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-64747663-b88a-4564-b507-76b6d492b77f req-f746b05c-37e1-4d74-a8d0-cf2529fa292e service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:51:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-64747663-b88a-4564-b507-76b6d492b77f req-f746b05c-37e1-4d74-a8d0-cf2529fa292e service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updated VIF entry in instance network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:51:44 user nova-compute[75006]: DEBUG nova.network.neutron [req-64747663-b88a-4564-b507-76b6d492b77f req-f746b05c-37e1-4d74-a8d0-cf2529fa292e service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:51:44 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-64747663-b88a-4564-b507-76b6d492b77f req-f746b05c-37e1-4d74-a8d0-cf2529fa292e service nova] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:51:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-777fe03c-be22-4520-af3e-4369197fd95c req-ef479779-836f-456b-ba13-9e04df320434 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG nova.compute.manager [req-777fe03c-be22-4520-af3e-4369197fd95c req-ef479779-836f-456b-ba13-9e04df320434 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing instance network info cache due to event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-777fe03c-be22-4520-af3e-4369197fd95c req-ef479779-836f-456b-ba13-9e04df320434 service nova] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-777fe03c-be22-4520-af3e-4369197fd95c req-ef479779-836f-456b-ba13-9e04df320434 service nova] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG nova.network.neutron [req-777fe03c-be22-4520-af3e-4369197fd95c req-ef479779-836f-456b-ba13-9e04df320434 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG nova.network.neutron [req-777fe03c-be22-4520-af3e-4369197fd95c req-ef479779-836f-456b-ba13-9e04df320434 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updated VIF entry in instance network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG nova.network.neutron [req-777fe03c-be22-4520-af3e-4369197fd95c req-ef479779-836f-456b-ba13-9e04df320434 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-777fe03c-be22-4520-af3e-4369197fd95c req-ef479779-836f-456b-ba13-9e04df320434 service nova] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:46 user nova-compute[75006]: INFO nova.compute.manager [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Rebooting instance
Nov 27 03:51:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:51:46 user nova-compute[75006]: DEBUG nova.network.neutron [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:51:47 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:47 user nova-compute[75006]: DEBUG nova.network.neutron [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:51:47 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:51:47 user nova-compute[75006]: DEBUG nova.compute.manager [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:51:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-be17ed0f-9ce1-4f1c-8312-fbdcc212fe74 req-ece6864d-c6fa-445b-a9b5-8e1bf8b08dab service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:51:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be17ed0f-9ce1-4f1c-8312-fbdcc212fe74 req-ece6864d-c6fa-445b-a9b5-8e1bf8b08dab service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be17ed0f-9ce1-4f1c-8312-fbdcc212fe74 req-ece6864d-c6fa-445b-a9b5-8e1bf8b08dab service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:50 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-be17ed0f-9ce1-4f1c-8312-fbdcc212fe74 req-ece6864d-c6fa-445b-a9b5-8e1bf8b08dab service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:50 user nova-compute[75006]: DEBUG nova.compute.manager [req-be17ed0f-9ce1-4f1c-8312-fbdcc212fe74 req-ece6864d-c6fa-445b-a9b5-8e1bf8b08dab service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:51:50 user nova-compute[75006]: WARNING nova.compute.manager [req-be17ed0f-9ce1-4f1c-8312-fbdcc212fe74 req-ece6864d-c6fa-445b-a9b5-8e1bf8b08dab service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state active and task_state reboot_started.
Nov 27 03:51:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance shutdown successfully.
Nov 27 03:51:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:51:52 user nova-compute[75006]: WARNING nova.compute.manager [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state active and task_state reboot_started.
Nov 27 03:51:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG nova.compute.manager [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:51:52 user nova-compute[75006]: WARNING nova.compute.manager [req-f740267e-3889-4bf2-a301-a183e4852503 req-1dfffe34-062f-4394-a67a-488732acdf6b service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state active and task_state reboot_started.
Nov 27 03:51:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:52 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance running successfully.
Nov 27 03:51:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance soft rebooted successfully.
Nov 27 03:51:54 user nova-compute[75006]: DEBUG nova.compute.manager [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:51:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-75f9a4f6-38fe-4f31-9a6b-cdbb899b7203 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.515s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-da57a557-b25d-4eb1-98d0-1e7fd42496cc req-790b170e-6e66-4bec-b736-7ed20aa86c27 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:51:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da57a557-b25d-4eb1-98d0-1e7fd42496cc req-790b170e-6e66-4bec-b736-7ed20aa86c27 service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:51:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da57a557-b25d-4eb1-98d0-1e7fd42496cc req-790b170e-6e66-4bec-b736-7ed20aa86c27 service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:51:54 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-da57a557-b25d-4eb1-98d0-1e7fd42496cc req-790b170e-6e66-4bec-b736-7ed20aa86c27 service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:51:54 user nova-compute[75006]: DEBUG nova.compute.manager [req-da57a557-b25d-4eb1-98d0-1e7fd42496cc req-790b170e-6e66-4bec-b736-7ed20aa86c27 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:51:54 user nova-compute[75006]: WARNING nova.compute.manager [req-da57a557-b25d-4eb1-98d0-1e7fd42496cc req-790b170e-6e66-4bec-b736-7ed20aa86c27 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state active and task_state None.
Nov 27 03:51:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:51:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:52:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:52:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:52:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:52:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:09 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:10 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:11 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:52:11 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:52:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:52:11 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:52:11 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:52:11 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:52:12 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:52:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:52:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:52:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:52:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:52:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:52:16 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:52:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:52:17 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:52:17 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:52:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8881MB free_disk=25.084911346435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:52:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:52:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:52:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:23 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:24 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:52:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:52:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:52:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:52:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:52:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:52:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:52:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:52:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:52:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:52:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:52:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:53:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:11 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:53:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:53:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:53:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:53:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:53:13 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:53:14 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:53:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:53:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:53:14 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:53:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:53:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:53:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:53:16 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:53:16 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:53:17 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:53:17 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:53:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.08358383178711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:53:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:53:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:53:23 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:25 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:53:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:53:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-c84d68cf-b157-4036-843b-fc34f5a1a161 req-084b53aa-1dbf-4ba9-8d0d-f1b98aa6a0c2 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.compute.manager [req-c84d68cf-b157-4036-843b-fc34f5a1a161 req-084b53aa-1dbf-4ba9-8d0d-f1b98aa6a0c2 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing instance network info cache due to event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c84d68cf-b157-4036-843b-fc34f5a1a161 req-084b53aa-1dbf-4ba9-8d0d-f1b98aa6a0c2 service nova] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c84d68cf-b157-4036-843b-fc34f5a1a161 req-084b53aa-1dbf-4ba9-8d0d-f1b98aa6a0c2 service nova] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.network.neutron [req-c84d68cf-b157-4036-843b-fc34f5a1a161 req-084b53aa-1dbf-4ba9-8d0d-f1b98aa6a0c2 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.network.neutron [req-c84d68cf-b157-4036-843b-fc34f5a1a161 req-084b53aa-1dbf-4ba9-8d0d-f1b98aa6a0c2 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updated VIF entry in instance network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.network.neutron [req-c84d68cf-b157-4036-843b-fc34f5a1a161 req-084b53aa-1dbf-4ba9-8d0d-f1b98aa6a0c2 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c84d68cf-b157-4036-843b-fc34f5a1a161 req-084b53aa-1dbf-4ba9-8d0d-f1b98aa6a0c2 service nova] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Verify base images {{(pid=75006) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Image id 19210244-b363-449a-b38c-be7439b56d33 yields fingerprint 961b623b98ad683eadd1655bd3416efe02b866ad {{(pid=75006) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] image 19210244-b363-449a-b38c-be7439b56d33 at (/opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad): checking
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] image 19210244-b363-449a-b38c-be7439b56d33 at (/opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad): image is in use {{(pid=75006) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75006) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] ec150b17-d8e5-457d-ba4a-7d85b4975e42 is a valid instance name {{(pid=75006) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] ec150b17-d8e5-457d-ba4a-7d85b4975e42 has a disk file {{(pid=75006) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 is backed by 961b623b98ad683eadd1655bd3416efe02b866ad {{(pid=75006) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f
Nov 27 03:53:38 user nova-compute[75006]: WARNING nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Active base files: /opt/stack/data/nova/instances/_base/961b623b98ad683eadd1655bd3416efe02b866ad
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Removable base files: /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60 /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656 /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84 /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727 /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f512782b6438a64b16939eb5c48fee85d295ac60
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9b274f3c5e2f5ed45281098995d9104386ee2fbd
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/008ba41f0f0f8dd7bafdc7f866d5db4e52cbd656
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b8ac6bcf34ac0fac07580ea3032488f6d4a68a84
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3ab4f0d09af59776b1f4f46b349ed92feaa1727
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ae095973783c790705f36d481c4d9179c3b0830d
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/45175aaada3c093c7cdd34674c63b69a3546e88f
Nov 27 03:53:38 user nova-compute[75006]: INFO nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4c118ec9f69ee550053e2222541010f46e184cb2
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Verification complete {{(pid=75006) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Verify swap images {{(pid=75006) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 27 03:53:38 user nova-compute[75006]: DEBUG nova.virt.libvirt.imagecache [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Verify ephemeral images {{(pid=75006) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-8faf0b2c-0663-4394-81ec-9d875c647bfe req-aacb3a34-8b87-4313-bfd8-0d84757e9aa0 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.compute.manager [req-8faf0b2c-0663-4394-81ec-9d875c647bfe req-aacb3a34-8b87-4313-bfd8-0d84757e9aa0 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing instance network info cache due to event network-changed-f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8faf0b2c-0663-4394-81ec-9d875c647bfe req-aacb3a34-8b87-4313-bfd8-0d84757e9aa0 service nova] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8faf0b2c-0663-4394-81ec-9d875c647bfe req-aacb3a34-8b87-4313-bfd8-0d84757e9aa0 service nova] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.network.neutron [req-8faf0b2c-0663-4394-81ec-9d875c647bfe req-aacb3a34-8b87-4313-bfd8-0d84757e9aa0 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Refreshing network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:53:39 user nova-compute[75006]: INFO nova.compute.manager [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Detaching volume cc66a308-6faf-4f17-a969-1c3ecca7a0c2
Nov 27 03:53:39 user nova-compute[75006]: INFO nova.virt.block_device [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Attempting to driver detach volume cc66a308-6faf-4f17-a969-1c3ecca7a0c2 from mountpoint /dev/vdb
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Attempting to detach device vdb from instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:53:39 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:53:39 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:53:39 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:53:39 user nova-compute[75006]:   <serial>cc66a308-6faf-4f17-a969-1c3ecca7a0c2</serial>
Nov 27 03:53:39 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:53:39 user nova-compute[75006]: </disk>
Nov 27 03:53:39 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:53:39 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully detached device vdb from instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 from the persistent domain config.
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:53:39 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:53:39 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:53:39 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:53:39 user nova-compute[75006]:   <serial>cc66a308-6faf-4f17-a969-1c3ecca7a0c2</serial>
Nov 27 03:53:39 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:53:39 user nova-compute[75006]: </disk>
Nov 27 03:53:39 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.network.neutron [req-8faf0b2c-0663-4394-81ec-9d875c647bfe req-aacb3a34-8b87-4313-bfd8-0d84757e9aa0 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updated VIF entry in instance network info cache for port f67a307d-3316-47d3-bfbe-451006aeb028. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.network.neutron [req-8faf0b2c-0663-4394-81ec-9d875c647bfe req-aacb3a34-8b87-4313-bfd8-0d84757e9aa0 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-8faf0b2c-0663-4394-81ec-9d875c647bfe req-aacb3a34-8b87-4313-bfd8-0d84757e9aa0 service nova] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:53:39 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:53:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:53:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:53:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:53:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:53:59 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 is timed out.
Nov 27 03:53:59 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully detached device vdb from instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 from the live domain config.
Nov 27 03:53:59 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gMZolDQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:53:59 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:53:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a39957-94f5-44c3-b2f0-c0e27f9b7340]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:53:59 user nova-compute[75006]: No targets found.
Nov 27 03:53:59 user nova-compute[75006]: iSNS:
Nov 27 03:53:59 user nova-compute[75006]: No targets found.
Nov 27 03:53:59 user nova-compute[75006]: STATIC:
Nov 27 03:53:59 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2
Nov 27 03:53:59 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:53:59 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:53:59 user nova-compute[75006]: FIRMWARE:
Nov 27 03:53:59 user nova-compute[75006]: No targets found.
Nov 27 03:53:59 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:53:59 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:53:59 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:53:59 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f696cb46-e42b-4502-9150-a2d6df073fb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2898ede-5242-4b49-a70a-e4072716eb0d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 (non-flash)
Nov 27 03:54:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 (non-flash)
Nov 27 03:54:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd43c2cf0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[13529e27-8912-4577-be6f-68bfc0c162fe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ab937c-4dca-402e-a600-05cde6ed449a]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c4058b-1c2c-46e1-93d8-0cd562e90e1a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc0d873-f20b-429c-9354-314b674b427a]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b838ae-0e05-41f3-a5d9-695b92169fd0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a6bfb-4927-45db-9583-3a9f12f30dfa]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2, portal: 172.16.0.220,3260]
Nov 27 03:54:00 user nova-compute[75006]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2, portal: 172.16.0.220,3260] successful.
Nov 27 03:54:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc66a308-6faf-4f17-a969-1c3ecca7a0c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91dba6c-eded-4b92-821f-4addb58c40dd]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] <== disconnect_volume: return (285ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'flavor' on Instance uuid ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:54:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-167e41d7-00fd-4779-8df5-c321720bffe9 tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.844s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:54:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:54:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:54:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:54:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:54:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:54:13 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:54:14 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [{"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:54:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-ec150b17-d8e5-457d-ba4a-7d85b4975e42" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:54:14 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:54:14 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:14 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:17 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:17 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:54:17 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:54:18 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:54:18 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:54:18 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.082805633544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:54:18 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:54:19 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:54:19 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:54:19 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:54:19 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:54:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:54:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:54:25 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:25 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:54:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:28 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:54:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:54:32 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:33 user nova-compute[75006]: INFO nova.compute.manager [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Terminating instance
Nov 27 03:54:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-1a3a6d0d-c7ab-49f0-9f82-bf277ddf5172 req-90cf988b-2487-4488-819e-a5e582af2657 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1a3a6d0d-c7ab-49f0-9f82-bf277ddf5172 req-90cf988b-2487-4488-819e-a5e582af2657 service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1a3a6d0d-c7ab-49f0-9f82-bf277ddf5172 req-90cf988b-2487-4488-819e-a5e582af2657 service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-1a3a6d0d-c7ab-49f0-9f82-bf277ddf5172 req-90cf988b-2487-4488-819e-a5e582af2657 service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-1a3a6d0d-c7ab-49f0-9f82-bf277ddf5172 req-90cf988b-2487-4488-819e-a5e582af2657 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG nova.compute.manager [req-1a3a6d0d-c7ab-49f0-9f82-bf277ddf5172 req-90cf988b-2487-4488-819e-a5e582af2657 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Instance destroyed successfully.
Nov 27 03:54:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lazy-loading 'resources' on Instance uuid ec150b17-d8e5-457d-ba4a-7d85b4975e42 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1730237124',display_name='tempest-TestMinimumBasicScenario-server-1730237124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1730237124',id=52,image_ref='19210244-b363-449a-b38c-be7439b56d33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpAZedwUlaUsLALtawwWqthGY/29DdQNPRdr2fz9wg3GUTG3/WQieCKhMQxcbDue586pTit7Zlr5GxoS9X3dXKUjq5I2eGQWa8pKfppBXLO/968xPeb3ZkulBu56VNPHA==',key_name='tempest-TestMinimumBasicScenario-1641280722',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:49:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='547df17332884139955057bf12619e4d',ramdisk_id='',reservation_id='r-ip7sfv07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='19210244-b363-449a-b38c-be7439b56d33',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1813903653',owner_user_name='tempest-TestMinimumBasicScenario-1813903653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:51:54Z,user_data=None,user_id='e3aa8e6a955544d2a360cc6c757d9768',uuid=ec150b17-d8e5-457d-ba4a-7d85b4975e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converting VIF {"id": "f67a307d-3316-47d3-bfbe-451006aeb028", "address": "fa:16:3e:e9:6e:74", "network": {"id": "aa368b38-0ca3-484f-84a0-ef18f7f00066", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-112560656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547df17332884139955057bf12619e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf67a307d-33", "ovs_interfaceid": "f67a307d-3316-47d3-bfbe-451006aeb028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:6e:74,bridge_name='br-int',has_traffic_filtering=True,id=f67a307d-3316-47d3-bfbe-451006aeb028,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf67a307d-33') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG os_vif [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:6e:74,bridge_name='br-int',has_traffic_filtering=True,id=f67a307d-3316-47d3-bfbe-451006aeb028,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf67a307d-33') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf67a307d-33, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7427ac33-5128-4a2b-a1cb-b7506566e4b3) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:33 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:33 user nova-compute[75006]: INFO os_vif [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:6e:74,bridge_name='br-int',has_traffic_filtering=True,id=f67a307d-3316-47d3-bfbe-451006aeb028,network=Network(aa368b38-0ca3-484f-84a0-ef18f7f00066),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf67a307d-33')
Nov 27 03:54:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Deleting instance files /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42_del
Nov 27 03:54:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Deletion of /opt/stack/data/nova/instances/ec150b17-d8e5-457d-ba4a-7d85b4975e42_del complete
Nov 27 03:54:34 user nova-compute[75006]: INFO nova.compute.manager [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 27 03:54:34 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:54:34 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Took 0.49 seconds to deallocate network for instance.
Nov 27 03:54:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-fae52d7a-8978-45da-9749-f81cde6be276 req-8b853131-4fed-4d26-b1f7-3d8822a6d3e7 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-deleted-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:54:34 user nova-compute[75006]: INFO nova.compute.manager [req-fae52d7a-8978-45da-9749-f81cde6be276 req-8b853131-4fed-4d26-b1f7-3d8822a6d3e7 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Neutron deleted interface f67a307d-3316-47d3-bfbe-451006aeb028; detaching it from the instance and deleting it from the info cache
Nov 27 03:54:34 user nova-compute[75006]: DEBUG nova.network.neutron [req-fae52d7a-8978-45da-9749-f81cde6be276 req-8b853131-4fed-4d26-b1f7-3d8822a6d3e7 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:54:34 user nova-compute[75006]: DEBUG nova.compute.manager [req-fae52d7a-8978-45da-9749-f81cde6be276 req-8b853131-4fed-4d26-b1f7-3d8822a6d3e7 service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Detach interface failed, port_id=f67a307d-3316-47d3-bfbe-451006aeb028, reason: Instance ec150b17-d8e5-457d-ba4a-7d85b4975e42 could not be found. {{(pid=75006) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:35 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Deleted allocations for instance ec150b17-d8e5-457d-ba4a-7d85b4975e42
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-291ed110-e122-489e-af4a-5bfc12a2461b tempest-TestMinimumBasicScenario-1813903653 tempest-TestMinimumBasicScenario-1813903653-project-member] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.102s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:54:35 user nova-compute[75006]: WARNING nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state deleted and task_state None.
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:54:35 user nova-compute[75006]: WARNING nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state deleted and task_state None.
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:54:35 user nova-compute[75006]: WARNING nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state deleted and task_state None.
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:54:35 user nova-compute[75006]: WARNING nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-unplugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state deleted and task_state None.
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Acquiring lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] Lock "ec150b17-d8e5-457d-ba4a-7d85b4975e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:54:35 user nova-compute[75006]: DEBUG nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] No waiting events found dispatching network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:54:35 user nova-compute[75006]: WARNING nova.compute.manager [req-e07ee0ba-b88f-4555-b657-727c3b49c911 req-ec5dcb50-d66c-4909-b3bd-da1c05c267cf service nova] [instance: ec150b17-d8e5-457d-ba4a-7d85b4975e42] Received unexpected event network-vif-plugged-f67a307d-3316-47d3-bfbe-451006aeb028 for instance with vm_state deleted and task_state None.
Nov 27 03:54:38 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:54:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:43 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:48 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:54:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:54:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:54:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:54:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:54:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:02 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:12 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:55:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:55:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:55:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:55:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:14 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:55:19 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:55:20 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:55:20 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:55:20 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=25.110031127929688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:55:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:55:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:55:20 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:55:20 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:55:20 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:55:20 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:55:20 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:55:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:55:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:24 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:24 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:55:25 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:26 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:55:28 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:55:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:55:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:55:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:55:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:55:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:55:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:55:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:56:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:56:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:56:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:56:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:56:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:56:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:56:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:56:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:56:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:56:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:56:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:15 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:17 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:19 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:56:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:56:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:56:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:56:20 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:56:21 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:56:21 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:56:21 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9134MB free_disk=25.140228271484375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:56:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:56:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:56:21 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:56:21 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:56:21 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:56:21 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:56:21 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:56:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:56:24 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:56:26 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:26 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:56:26 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:26 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:56:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:56:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:56:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:56:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:29 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:30 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:56:34 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:39 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:44 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:56:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:56:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:56:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:56:54 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:57 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:56:59 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:00 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:03 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:04 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:09 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:12 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:12 user nova-compute[75006]: DEBUG nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Starting instance... {{(pid=75006) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75006) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 03:57:13 user nova-compute[75006]: INFO nova.compute.claims [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Claim successful on node user
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Start building networks asynchronously for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Allocating IP information in the background. {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.network.neutron [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] allocate_for_instance() {{(pid=75006) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 03:57:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Start building block device mappings for instance. {{(pid=75006) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.policy [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b11e3819d624b6a9e03fee61d15c471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdf39676a494b1593cc4c196f6f17f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75006) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Start spawning the instance on the hypervisor. {{(pid=75006) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Creating instance directory {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 03:57:13 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Creating image(s)
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "/opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "/opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Skipping network cache update for instance because it is Building. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.182s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:13 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.211s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk 1073741824 {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe,backing_fmt=raw /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk 1073741824" returned: 0 in 0.052s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "184ff41cbec1c6437694edf5e7d1f2e6d3280ebe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/184ff41cbec1c6437694edf5e7d1f2e6d3280ebe --force-share --output=json" returned: 0 in 0.191s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk. size=1073741824 {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG nova.virt.disk.api [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Cannot resize image /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk to a smaller size. {{(pid=75006) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Created local disks {{(pid=75006) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Ensure instance console log exists: /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/console.log {{(pid=75006) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG nova.network.neutron [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Successfully created port: 903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 03:57:14 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.neutron [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Successfully updated port: 903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.neutron [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Building network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.neutron [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Instance cache missing network info. {{(pid=75006) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-c2403791-ab7c-4c2a-97f0-d6c840f0e16c req-2eaeed6b-5d61-4499-80bc-62e706931d33 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received event network-changed-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.compute.manager [req-c2403791-ab7c-4c2a-97f0-d6c840f0e16c req-2eaeed6b-5d61-4499-80bc-62e706931d33 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Refreshing instance network info cache due to event network-changed-903d03a0-c67d-42e1-90c6-1643887466c8. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2403791-ab7c-4c2a-97f0-d6c840f0e16c req-2eaeed6b-5d61-4499-80bc-62e706931d33 service nova] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.neutron [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Instance network_info: |[{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75006) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2403791-ab7c-4c2a-97f0-d6c840f0e16c req-2eaeed6b-5d61-4499-80bc-62e706931d33 service nova] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2403791-ab7c-4c2a-97f0-d6c840f0e16c req-2eaeed6b-5d61-4499-80bc-62e706931d33 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Refreshing network info cache for port 903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Start _get_guest_xml network_info=[{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e19384e9-bd8b-46ce-9cf0-3cac8b3d8868'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 03:57:15 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:57:15 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] CPU controller missing on host. {{(pid=75006) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.host [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] CPU controller found on host. {{(pid=75006) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75006) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T03:13:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T03:14:07Z,direct_url=<?>,disk_format='qcow2',id=e19384e9-bd8b-46ce-9cf0-3cac8b3d8868,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='dcfabeafce3d4317a5394e7ee6c3ec8f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T03:14:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Flavor limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Image limits 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Flavor pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Image pref 0:0:0 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Got 1 possible topologies {{(pid=75006) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.hardware [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75006) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:57:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1777510412',display_name='tempest-SnapshotDataIntegrityTests-server-1777510412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1777510412',id=53,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNqid5F03p5BvXyHmZ7bD6v83eio40VIme2S3ol7bQimVz4f7sN5CZ5EbTwQoi0ycl2zz+eLTLAjf7asGpNCCEROz10xbc5sVhRll9t9OjdsezoQDYkmrIBnOu9y6Tmgw==',key_name='tempest-keypair-25635503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bdf39676a494b1593cc4c196f6f17f5',ramdisk_id='',reservation_id='r-bsttybxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1094860346',owner_user_name='tempest-SnapshotDataIntegrityTests-1094860346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:57:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b11e3819d624b6a9e03fee61d15c471',uuid=bf37ecbf-497b-494f-a969-98052f650e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75006) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Converting VIF {"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:de:6b,bridge_name='br-int',has_traffic_filtering=True,id=903d03a0-c67d-42e1-90c6-1643887466c8,network=Network(e6996cc1-91eb-443d-b785-7f5591a084a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903d03a0-c6') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.objects.instance [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'pci_devices' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] End _get_guest_xml xml=<domain type="kvm">
Nov 27 03:57:15 user nova-compute[75006]:   <uuid>bf37ecbf-497b-494f-a969-98052f650e54</uuid>
Nov 27 03:57:15 user nova-compute[75006]:   <name>instance-00000035</name>
Nov 27 03:57:15 user nova-compute[75006]:   <memory>524288</memory>
Nov 27 03:57:15 user nova-compute[75006]:   <vcpu>1</vcpu>
Nov 27 03:57:15 user nova-compute[75006]:   <metadata>
Nov 27 03:57:15 user nova-compute[75006]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 03:57:15 user nova-compute[75006]:       <nova:package version="0.0.0"/>
Nov 27 03:57:15 user nova-compute[75006]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1777510412</nova:name>
Nov 27 03:57:15 user nova-compute[75006]:       <nova:creationTime>2023-11-27 03:57:15</nova:creationTime>
Nov 27 03:57:15 user nova-compute[75006]:       <nova:flavor name="m1.tiny">
Nov 27 03:57:15 user nova-compute[75006]:         <nova:memory>512</nova:memory>
Nov 27 03:57:15 user nova-compute[75006]:         <nova:disk>1</nova:disk>
Nov 27 03:57:15 user nova-compute[75006]:         <nova:swap>0</nova:swap>
Nov 27 03:57:15 user nova-compute[75006]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 03:57:15 user nova-compute[75006]:         <nova:vcpus>1</nova:vcpus>
Nov 27 03:57:15 user nova-compute[75006]:       </nova:flavor>
Nov 27 03:57:15 user nova-compute[75006]:       <nova:owner>
Nov 27 03:57:15 user nova-compute[75006]:         <nova:user uuid="9b11e3819d624b6a9e03fee61d15c471">tempest-SnapshotDataIntegrityTests-1094860346-project-member</nova:user>
Nov 27 03:57:15 user nova-compute[75006]:         <nova:project uuid="2bdf39676a494b1593cc4c196f6f17f5">tempest-SnapshotDataIntegrityTests-1094860346</nova:project>
Nov 27 03:57:15 user nova-compute[75006]:       </nova:owner>
Nov 27 03:57:15 user nova-compute[75006]:       <nova:root type="image" uuid="e19384e9-bd8b-46ce-9cf0-3cac8b3d8868"/>
Nov 27 03:57:15 user nova-compute[75006]:       <nova:ports>
Nov 27 03:57:15 user nova-compute[75006]:         <nova:port uuid="903d03a0-c67d-42e1-90c6-1643887466c8">
Nov 27 03:57:15 user nova-compute[75006]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 03:57:15 user nova-compute[75006]:         </nova:port>
Nov 27 03:57:15 user nova-compute[75006]:       </nova:ports>
Nov 27 03:57:15 user nova-compute[75006]:     </nova:instance>
Nov 27 03:57:15 user nova-compute[75006]:   </metadata>
Nov 27 03:57:15 user nova-compute[75006]:   <sysinfo type="smbios">
Nov 27 03:57:15 user nova-compute[75006]:     <system>
Nov 27 03:57:15 user nova-compute[75006]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 03:57:15 user nova-compute[75006]:       <entry name="product">OpenStack Nova</entry>
Nov 27 03:57:15 user nova-compute[75006]:       <entry name="version">0.0.0</entry>
Nov 27 03:57:15 user nova-compute[75006]:       <entry name="serial">bf37ecbf-497b-494f-a969-98052f650e54</entry>
Nov 27 03:57:15 user nova-compute[75006]:       <entry name="uuid">bf37ecbf-497b-494f-a969-98052f650e54</entry>
Nov 27 03:57:15 user nova-compute[75006]:       <entry name="family">Virtual Machine</entry>
Nov 27 03:57:15 user nova-compute[75006]:     </system>
Nov 27 03:57:15 user nova-compute[75006]:   </sysinfo>
Nov 27 03:57:15 user nova-compute[75006]:   <os>
Nov 27 03:57:15 user nova-compute[75006]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 03:57:15 user nova-compute[75006]:     <boot dev="hd"/>
Nov 27 03:57:15 user nova-compute[75006]:     <smbios mode="sysinfo"/>
Nov 27 03:57:15 user nova-compute[75006]:   </os>
Nov 27 03:57:15 user nova-compute[75006]:   <features>
Nov 27 03:57:15 user nova-compute[75006]:     <acpi/>
Nov 27 03:57:15 user nova-compute[75006]:     <apic/>
Nov 27 03:57:15 user nova-compute[75006]:     <vmcoreinfo/>
Nov 27 03:57:15 user nova-compute[75006]:   </features>
Nov 27 03:57:15 user nova-compute[75006]:   <clock offset="utc">
Nov 27 03:57:15 user nova-compute[75006]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 03:57:15 user nova-compute[75006]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 03:57:15 user nova-compute[75006]:     <timer name="hpet" present="no"/>
Nov 27 03:57:15 user nova-compute[75006]:   </clock>
Nov 27 03:57:15 user nova-compute[75006]:   <cpu mode="custom" match="exact">
Nov 27 03:57:15 user nova-compute[75006]:     <model>Nehalem</model>
Nov 27 03:57:15 user nova-compute[75006]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 03:57:15 user nova-compute[75006]:   </cpu>
Nov 27 03:57:15 user nova-compute[75006]:   <devices>
Nov 27 03:57:15 user nova-compute[75006]:     <disk type="file" device="disk">
Nov 27 03:57:15 user nova-compute[75006]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 03:57:15 user nova-compute[75006]:       <source file="/opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk"/>
Nov 27 03:57:15 user nova-compute[75006]:       <target dev="vda" bus="virtio"/>
Nov 27 03:57:15 user nova-compute[75006]:     </disk>
Nov 27 03:57:15 user nova-compute[75006]:     <interface type="ethernet">
Nov 27 03:57:15 user nova-compute[75006]:       <mac address="fa:16:3e:1e:de:6b"/>
Nov 27 03:57:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:57:15 user nova-compute[75006]:       <mtu size="1442"/>
Nov 27 03:57:15 user nova-compute[75006]:       <target dev="tap903d03a0-c6"/>
Nov 27 03:57:15 user nova-compute[75006]:     </interface>
Nov 27 03:57:15 user nova-compute[75006]:     <serial type="pty">
Nov 27 03:57:15 user nova-compute[75006]:       <log file="/opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/console.log" append="off"/>
Nov 27 03:57:15 user nova-compute[75006]:     </serial>
Nov 27 03:57:15 user nova-compute[75006]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 03:57:15 user nova-compute[75006]:     <video>
Nov 27 03:57:15 user nova-compute[75006]:       <model type="virtio"/>
Nov 27 03:57:15 user nova-compute[75006]:     </video>
Nov 27 03:57:15 user nova-compute[75006]:     <rng model="virtio">
Nov 27 03:57:15 user nova-compute[75006]:       <backend model="random">/dev/urandom</backend>
Nov 27 03:57:15 user nova-compute[75006]:     </rng>
Nov 27 03:57:15 user nova-compute[75006]:     <controller type="usb" index="0" model="none"/>
Nov 27 03:57:15 user nova-compute[75006]:     <memballoon model="virtio">
Nov 27 03:57:15 user nova-compute[75006]:       <stats period="10"/>
Nov 27 03:57:15 user nova-compute[75006]:     </memballoon>
Nov 27 03:57:15 user nova-compute[75006]:   </devices>
Nov 27 03:57:15 user nova-compute[75006]: </domain>
Nov 27 03:57:15 user nova-compute[75006]:  {{(pid=75006) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:57:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1777510412',display_name='tempest-SnapshotDataIntegrityTests-server-1777510412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1777510412',id=53,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNqid5F03p5BvXyHmZ7bD6v83eio40VIme2S3ol7bQimVz4f7sN5CZ5EbTwQoi0ycl2zz+eLTLAjf7asGpNCCEROz10xbc5sVhRll9t9OjdsezoQDYkmrIBnOu9y6Tmgw==',key_name='tempest-keypair-25635503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bdf39676a494b1593cc4c196f6f17f5',ramdisk_id='',reservation_id='r-bsttybxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1094860346',owner_user_name='tempest-SnapshotDataIntegrityTests-1094860346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T03:57:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b11e3819d624b6a9e03fee61d15c471',uuid=bf37ecbf-497b-494f-a969-98052f650e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Converting VIF {"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:de:6b,bridge_name='br-int',has_traffic_filtering=True,id=903d03a0-c67d-42e1-90c6-1643887466c8,network=Network(e6996cc1-91eb-443d-b785-7f5591a084a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903d03a0-c6') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG os_vif [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:de:6b,bridge_name='br-int',has_traffic_filtering=True,id=903d03a0-c67d-42e1-90c6-1643887466c8,network=Network(e6996cc1-91eb-443d-b785-7f5591a084a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903d03a0-c6') {{(pid=75006) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18723764-67ac-5cc8-be52-fc422af8211c', '_type': 'linux-noop'}}, row=False) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:15 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903d03a0-c6, may_exist=True, interface_attrs={}) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap903d03a0-c6, col_values=(('qos', UUID('65471588-a6a1-4e11-9f8f-b864c2c097e6')),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap903d03a0-c6, col_values=(('external_ids', {'iface-id': '903d03a0-c67d-42e1-90c6-1643887466c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:de:6b', 'vm-uuid': 'bf37ecbf-497b-494f-a969-98052f650e54'}),), if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:16 user nova-compute[75006]: INFO os_vif [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:de:6b,bridge_name='br-int',has_traffic_filtering=True,id=903d03a0-c67d-42e1-90c6-1643887466c8,network=Network(e6996cc1-91eb-443d-b785-7f5591a084a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903d03a0-c6')
Nov 27 03:57:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No VIF found with MAC fa:16:3e:1e:de:6b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2403791-ab7c-4c2a-97f0-d6c840f0e16c req-2eaeed6b-5d61-4499-80bc-62e706931d33 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updated VIF entry in instance network info cache for port 903d03a0-c67d-42e1-90c6-1643887466c8. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG nova.network.neutron [req-c2403791-ab7c-4c2a-97f0-d6c840f0e16c req-2eaeed6b-5d61-4499-80bc-62e706931d33 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-c2403791-ab7c-4c2a-97f0-d6c840f0e16c req-2eaeed6b-5d61-4499-80bc-62e706931d33 service nova] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:17 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-3e104557-9207-4ede-94d3-23e0b70dd469 req-474a1512-e5bf-4a8a-8ebf-0962729070ca service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received event network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:57:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3e104557-9207-4ede-94d3-23e0b70dd469 req-474a1512-e5bf-4a8a-8ebf-0962729070ca service nova] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3e104557-9207-4ede-94d3-23e0b70dd469 req-474a1512-e5bf-4a8a-8ebf-0962729070ca service nova] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-3e104557-9207-4ede-94d3-23e0b70dd469 req-474a1512-e5bf-4a8a-8ebf-0962729070ca service nova] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:17 user nova-compute[75006]: DEBUG nova.compute.manager [req-3e104557-9207-4ede-94d3-23e0b70dd469 req-474a1512-e5bf-4a8a-8ebf-0962729070ca service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] No waiting events found dispatching network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:57:17 user nova-compute[75006]: WARNING nova.compute.manager [req-3e104557-9207-4ede-94d3-23e0b70dd469 req-474a1512-e5bf-4a8a-8ebf-0962729070ca service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received unexpected event network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 for instance with vm_state building and task_state spawning.
Nov 27 03:57:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:18 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Instance event wait completed in 0 seconds for  {{(pid=75006) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Guest created on hypervisor {{(pid=75006) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 03:57:19 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Instance spawned successfully.
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Found default for hw_cdrom_bus of ide {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Found default for hw_disk_bus of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Found default for hw_input_bus of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Found default for hw_pointer_model of None {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Found default for hw_video_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Found default for hw_vif_model of virtio {{(pid=75006) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-59962d86-2baf-4916-bcb3-a85f45633553 req-7fd19624-5de6-4f53-b66b-370a75dfbe2f service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received event network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-59962d86-2baf-4916-bcb3-a85f45633553 req-7fd19624-5de6-4f53-b66b-370a75dfbe2f service nova] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-59962d86-2baf-4916-bcb3-a85f45633553 req-7fd19624-5de6-4f53-b66b-370a75dfbe2f service nova] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-59962d86-2baf-4916-bcb3-a85f45633553 req-7fd19624-5de6-4f53-b66b-370a75dfbe2f service nova] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.compute.manager [req-59962d86-2baf-4916-bcb3-a85f45633553 req-7fd19624-5de6-4f53-b66b-370a75dfbe2f service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] No waiting events found dispatching network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 03:57:19 user nova-compute[75006]: WARNING nova.compute.manager [req-59962d86-2baf-4916-bcb3-a85f45633553 req-7fd19624-5de6-4f53-b66b-370a75dfbe2f service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received unexpected event network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 for instance with vm_state building and task_state spawning.
Nov 27 03:57:19 user nova-compute[75006]: INFO nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 27 03:57:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Checking state {{(pid=75006) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 03:57:20 user nova-compute[75006]: INFO nova.compute.manager [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Took 6.99 seconds to build instance.
Nov 27 03:57:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-81903b40-b872-46ef-ac90-dc04a0f314a9 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.211s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:21 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:57:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:57:22 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:57:22 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:57:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.13253402709961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance bf37ecbf-497b-494f-a969-98052f650e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:57:22 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:57:23 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:57:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:57:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:57:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:57:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:57:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:45 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:50 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:57:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:58:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:58:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:58:15 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:58:15 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:58:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:17 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:17 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:58:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:58:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:58:21 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:58:21 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:58:22 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:58:22 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:58:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8990MB free_disk=25.094749450683594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance bf37ecbf-497b-494f-a969-98052f650e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:58:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:58:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:58:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:58:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:58:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:58:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:58:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:58:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:58:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:58:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:59:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:59:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:59:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:59:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-21a708ec-2833-424c-8782-a42af8772b62 req-071495e1-b38d-4563-9e3b-3f362e85fad0 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received event network-changed-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 03:59:03 user nova-compute[75006]: DEBUG nova.compute.manager [req-21a708ec-2833-424c-8782-a42af8772b62 req-071495e1-b38d-4563-9e3b-3f362e85fad0 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Refreshing instance network info cache due to event network-changed-903d03a0-c67d-42e1-90c6-1643887466c8. {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 03:59:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-21a708ec-2833-424c-8782-a42af8772b62 req-071495e1-b38d-4563-9e3b-3f362e85fad0 service nova] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:59:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-21a708ec-2833-424c-8782-a42af8772b62 req-071495e1-b38d-4563-9e3b-3f362e85fad0 service nova] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:59:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-21a708ec-2833-424c-8782-a42af8772b62 req-071495e1-b38d-4563-9e3b-3f362e85fad0 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Refreshing network info cache for port 903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 03:59:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-21a708ec-2833-424c-8782-a42af8772b62 req-071495e1-b38d-4563-9e3b-3f362e85fad0 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updated VIF entry in instance network info cache for port 903d03a0-c67d-42e1-90c6-1643887466c8. {{(pid=75006) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 03:59:03 user nova-compute[75006]: DEBUG nova.network.neutron [req-21a708ec-2833-424c-8782-a42af8772b62 req-071495e1-b38d-4563-9e3b-3f362e85fad0 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:59:03 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-21a708ec-2833-424c-8782-a42af8772b62 req-071495e1-b38d-4563-9e3b-3f362e85fad0 service nova] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:59:05 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG nova.objects.instance [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:59:08 user nova-compute[75006]: INFO nova.compute.manager [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attaching volume a22994be-98d3-4132-8f73-f0f0a7b0fa5b to /dev/vdb
Nov 27 03:59:08 user nova-compute[75006]: DEBUG os_brick.utils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[385d6cb2-dfc8-44dc-bb85-6253c75befd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d48c5b-d918-4259-8f20-1229659bb99a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c305dde-6a46-41e1-94eb-c0e895daf0b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a514e0e9-15ba-4470-beb7-f4243d71f445]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 03:59:08 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 03:59:08 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b17f9a8-21b2-46f5-bc45-e53568e013d6]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG os_brick.utils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:59:08 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating existing volume attachment record: 198811f5-3ab7-42e2-82b6-23d81abeed83 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 03:59:10 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCBqHPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:59:14 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:59:14 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:59:14 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd9b20-33d7-4d07-81b9-97badd42634b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 03:59:14 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8a6df-4548-4bfe-91aa-e39c2f24600d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b] added
Nov 27 03:59:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21bd1e9-e016-45ca-9748-6fc564841e64]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[517c6b06-5838-4573-a921-9ab395a133b0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGCBqHPF {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGCBqHPF" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d46980-c8b5-4077-9bc2-aea44f4adf21]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGCBqHPF'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3954189d-1c09-4f8f-a2c0-29d8bfeb5697]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[838b2557-0c25-4def-b36e-2fa52fd7183e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 03:59:14 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 03:59:14 user nova-compute[75006]:  {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:59:14 user nova-compute[75006]: WARNING os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 03:59:14 user nova-compute[75006]: 
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cf8198-c910-459b-b31d-1f275aa9a61e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b, portal: 172.16.0.220,3260]
Nov 27 03:59:14 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b, portal: 172.16.0.220,3260] successful.
Nov 27 03:59:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eddb70-c774-491b-acc8-7c70abed3679]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3781bb-e25e-4838-9f18-dc353afecca3]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b (non-flash)
Nov 27 03:59:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b (non-flash)
Nov 27 03:59:14 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea604560-7230-4f97-8988-fb7c42266d15]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 03:59:14 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCBqHPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23034316363643832', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034316363643832', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG nova.objects.instance [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 03:59:15 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:59:15 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:59:15 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:59:15 user nova-compute[75006]:   <serial>a22994be-98d3-4132-8f73-f0f0a7b0fa5b</serial>
Nov 27 03:59:15 user nova-compute[75006]: </disk>
Nov 27 03:59:15 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No VIF found with MAC fa:16:3e:1e:de:6b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 03:59:15 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-42ec717f-11ac-47e5-b70e-0975031ec71e tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.685s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:59:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:59:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:59:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:59:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:59:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:17 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 03:59:17 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 03:59:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 03:59:17 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 03:59:17 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 03:59:17 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:59:18 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 03:59:18 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 03:59:18 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 03:59:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:20 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:59:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:59:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:59:22 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 03:59:22 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75006) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 03:59:23 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:59:23 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 03:59:23 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8990MB free_disk=25.093685150146484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance bf37ecbf-497b-494f-a969-98052f650e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 03:59:23 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 03:59:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:59:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 03:59:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:27 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 03:59:28 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 03:59:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 03:59:30 user nova-compute[75006]: INFO nova.compute.manager [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Detaching volume a22994be-98d3-4132-8f73-f0f0a7b0fa5b
Nov 27 03:59:30 user nova-compute[75006]: INFO nova.virt.block_device [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attempting to driver detach volume a22994be-98d3-4132-8f73-f0f0a7b0fa5b from mountpoint /dev/vdb
Nov 27 03:59:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Attempting to detach device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 03:59:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:59:30 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:59:30 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:59:30 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:59:30 user nova-compute[75006]:   <serial>a22994be-98d3-4132-8f73-f0f0a7b0fa5b</serial>
Nov 27 03:59:30 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:59:30 user nova-compute[75006]: </disk>
Nov 27 03:59:30 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:59:30 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully detached device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the persistent domain config.
Nov 27 03:59:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf37ecbf-497b-494f-a969-98052f650e54 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 03:59:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 03:59:30 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 03:59:30 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 03:59:30 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 03:59:30 user nova-compute[75006]:   <serial>a22994be-98d3-4132-8f73-f0f0a7b0fa5b</serial>
Nov 27 03:59:30 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 03:59:30 user nova-compute[75006]: </disk>
Nov 27 03:59:30 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 03:59:30 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 03:59:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:34 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 03:59:34 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 03:59:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:59:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:59:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:59:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:59:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:46 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 03:59:50 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf37ecbf-497b-494f-a969-98052f650e54 is timed out.
Nov 27 03:59:50 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully detached device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the live domain config.
Nov 27 03:59:50 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCBqHPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 03:59:50 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3d8b7c-3199-4123-9553-e25da7908012]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 03:59:50 user nova-compute[75006]: No targets found.
Nov 27 03:59:50 user nova-compute[75006]: iSNS:
Nov 27 03:59:50 user nova-compute[75006]: No targets found.
Nov 27 03:59:50 user nova-compute[75006]: STATIC:
Nov 27 03:59:50 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b
Nov 27 03:59:50 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 03:59:50 user nova-compute[75006]:                 Iface Name: default
Nov 27 03:59:50 user nova-compute[75006]: FIRMWARE:
Nov 27 03:59:50 user nova-compute[75006]: No targets found.
Nov 27 03:59:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 03:59:50 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 03:59:50 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c0e92-7edd-46f3-ac5e-f6a3077d122d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[144fb6ef-0b38-465e-b684-25168a1a267b]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b (non-flash)
Nov 27 03:59:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b (non-flash)
Nov 27 03:59:50 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[70beae9a-7f49-4782-a1cb-9a12f0119685]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[920ffd9a-0cbf-4836-94b4-7a3336cacb11]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a9ad9-696b-4ec8-a199-4923e6654524]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d25813e-3252-4b5b-b25c-11fbfd44ca8b]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23a923d-9a32-4fc3-a028-46c06f045a37]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:50 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd49dad-0ea4-4b08-84a4-67da67613423]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b, portal: 172.16.0.220,3260]
Nov 27 03:59:51 user nova-compute[75006]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b, portal: 172.16.0.220,3260] successful.
Nov 27 03:59:51 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a22994be-98d3-4132-8f73-f0f0a7b0fa5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[126d3e9f-03f2-4e60-a316-11b3745836cc]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== disconnect_volume: return (261ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 03:59:51 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aae5b4da-9dfd-4265-b666-bd77d0daa97f tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.659s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 03:59:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:00:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:00:16 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:00:19 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:00:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:00:19 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:00:19 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:00:19 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:00:20 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:00:20 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:00:20 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:00:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:00:23 user nova-compute[75006]: INFO nova.compute.manager [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attaching volume 0bac66f5-120f-4915-a53f-ea2559d41a82 to /dev/vdb
Nov 27 04:00:23 user nova-compute[75006]: DEBUG os_brick.utils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c7ad31-8fa2-46ac-a56b-23bacaeabbe0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb03baaf-3969-435a-b091-02af11b6ffe3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b452dfb-a2a9-452c-bc61-68091f29ded6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb98eb1-f8b4-4ec7-9627-1501252dcaf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:00:23 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:00:23 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ac92a0-2610-4b17-8532-6f89f9ea0c2d]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG os_brick.utils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:00:23 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating existing volume attachment record: 75942b85-87f7-4be0-ab0e-49a0710e16d6 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:00:24 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:24 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:00:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.006s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:00:24 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:00:24 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:00:24 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:25 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:00:25 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:00:25 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.092723846435547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance bf37ecbf-497b-494f-a969-98052f650e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:00:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:00:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsyDtLCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:00:29 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:00:29 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:00:29 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5350fdf2-b11c-4d34-a088-41e7817cf522]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:00:29 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f17ec-3ee8-460d-883e-d91d3bbf966a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82] added
Nov 27 04:00:29 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d091ea6e-595e-456b-885a-1bd7c11ea16a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[30171c8e-d787-4b91-a3ae-8f76b3a5ad2a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dsyDtLCe {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dsyDtLCe" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d255ea-6e64-43e1-ac3d-aa7666859997]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dsyDtLCe'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7807a8-837c-4071-ba84-7a2a12ab7ddc]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3edafc-259a-4cb0-9c61-7123fe5477a5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:00:29 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:00:29 user nova-compute[75006]:  {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:00:29 user nova-compute[75006]: WARNING os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 04:00:29 user nova-compute[75006]: 
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c839a33-3a5a-4f7d-b08e-cacafda3381c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82, portal: 172.16.0.220,3260]
Nov 27 04:00:29 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82, portal: 172.16.0.220,3260] successful.
Nov 27 04:00:29 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.056s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab7b4b-585d-4f95-a1a7-e7e2f3fba1e2]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b5aa01-a6bf-445e-b96a-be42aa2d6a0d]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 (non-flash)
Nov 27 04:00:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 (non-flash)
Nov 27 04:00:30 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e32d21-9d8b-4baf-a5f3-06efd9849473]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:00:30 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsyDtLCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23532663564646434', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532663564646434', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG nova.objects.instance [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:00:31 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:00:31 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:00:31 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:00:31 user nova-compute[75006]:   <serial>0bac66f5-120f-4915-a53f-ea2559d41a82</serial>
Nov 27 04:00:31 user nova-compute[75006]: </disk>
Nov 27 04:00:31 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No VIF found with MAC fa:16:3e:1e:de:6b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-6e591564-ade8-48a9-ae4c-84c4a00111ef tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.989s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:00:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:00:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:00:33 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:00:33 user nova-compute[75006]: INFO nova.compute.manager [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Detaching volume 0bac66f5-120f-4915-a53f-ea2559d41a82
Nov 27 04:00:33 user nova-compute[75006]: INFO nova.virt.block_device [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attempting to driver detach volume 0bac66f5-120f-4915-a53f-ea2559d41a82 from mountpoint /dev/vdb
Nov 27 04:00:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Attempting to detach device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:00:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:00:33 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:00:33 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:00:33 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:00:33 user nova-compute[75006]:   <serial>0bac66f5-120f-4915-a53f-ea2559d41a82</serial>
Nov 27 04:00:33 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:00:33 user nova-compute[75006]: </disk>
Nov 27 04:00:33 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:00:33 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully detached device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the persistent domain config.
Nov 27 04:00:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf37ecbf-497b-494f-a969-98052f650e54 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:00:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:00:33 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:00:33 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:00:33 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:00:33 user nova-compute[75006]:   <serial>0bac66f5-120f-4915-a53f-ea2559d41a82</serial>
Nov 27 04:00:33 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:00:33 user nova-compute[75006]: </disk>
Nov 27 04:00:33 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:00:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:00:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:00:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:00:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:00:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:00:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:00:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:00:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:00:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:00:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:00:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:00:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:00:54 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf37ecbf-497b-494f-a969-98052f650e54 is timed out.
Nov 27 04:00:54 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully detached device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the live domain config.
Nov 27 04:00:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dsyDtLCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:00:54 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1734bbb8-bc92-48ec-b9bb-9af8327638eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:00:54 user nova-compute[75006]: No targets found.
Nov 27 04:00:54 user nova-compute[75006]: iSNS:
Nov 27 04:00:54 user nova-compute[75006]: No targets found.
Nov 27 04:00:54 user nova-compute[75006]: STATIC:
Nov 27 04:00:54 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82
Nov 27 04:00:54 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:00:54 user nova-compute[75006]:                 Iface Name: default
Nov 27 04:00:54 user nova-compute[75006]: FIRMWARE:
Nov 27 04:00:54 user nova-compute[75006]: No targets found.
Nov 27 04:00:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:00:54 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:00:54 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19497e-1a64-4e5f-8aea-443deeadd973]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[538b285a-c7df-4693-a8b9-7b1f06cc6341]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 (non-flash)
Nov 27 04:00:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 (non-flash)
Nov 27 04:00:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4241e1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3969fdd-17b1-4d5d-b370-1d7caa5e7943]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf0c983-5a72-477a-b743-1b64732f65f2]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac6709c-166a-460d-b8fb-3ae21121639c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e509afab-668a-42fe-a8f2-4c0344b978a0]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f905138-cdd6-43fe-9907-3162e0700e9a]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5649704f-5f5d-48c4-a520-ffc40a414776]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82, portal: 172.16.0.220,3260]
Nov 27 04:00:54 user nova-compute[75006]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82, portal: 172.16.0.220,3260] successful.
Nov 27 04:00:54 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bac66f5-120f-4915-a53f-ea2559d41a82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b90a25-d94a-42b6-b177-9f187a5d1871]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== disconnect_volume: return (247ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:00:54 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:00:55 user nova-compute[75006]: DEBUG nova.objects.instance [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:00:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d380915c-7838-4653-bfca-e7a4dde4a315 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.604s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:00:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:01:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:01:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:01:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:01:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:01:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:01:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:18 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:01:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:01:21 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:01:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:01:21 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:01:21 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:01:21 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:01:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:01:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:01:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:01:25 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:25 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:01:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:01:25 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:01:25 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:01:25 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:25 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.objects.instance [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:26 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:01:26 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=25.091861724853516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:01:26 user nova-compute[75006]: INFO nova.compute.manager [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attaching volume 787ac1dc-e012-4d82-9a3f-93eecd7c862c to /dev/vdb
Nov 27 04:01:26 user nova-compute[75006]: DEBUG os_brick.utils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance bf37ecbf-497b-494f-a969-98052f650e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dd8cc1-5b8c-4b9f-bd46-e470ee65a0ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1eed2b-cb5f-4e68-8659-a6cf8cc416d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[87384282-0003-4aaf-a456-e71081454e00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1947969-95c6-4f93-971d-140bbf1d4836]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:01:26 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[34468c1c-5e56-4c83-9161-a8dc2f8a2e51]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG os_brick.utils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating existing volume attachment record: 5fce9bee-311c-407a-b6a8-4fd37ae829f7 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:01:26 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:01:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:01:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTWPuKBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:01:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:01:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:01:32 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc9d9e-75e8-4992-9a02-98d1a0380088]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:01:32 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[4931a4e9-5db3-4191-9d17-a14fc46147b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c] added
Nov 27 04:01:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd13854-1439-47ba-8c7d-ae70c418f8c7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[485eaf40-9d41-4452-95c9-512032967d68]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTWPuKBj {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTWPuKBj" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4f52a5-91fd-4a03-b839-6c84155d90d5]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HTWPuKBj'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[421556df-9204-4727-91be-d5e759828854]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcfd851-e03e-4ae0-9552-095d83115a4c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:01:32 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:01:32 user nova-compute[75006]:  {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:01:32 user nova-compute[75006]: WARNING os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 04:01:32 user nova-compute[75006]: 
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8921970b-04db-49cc-af77-99c8c38ea5cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c, portal: 172.16.0.220,3260]
Nov 27 04:01:32 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c, portal: 172.16.0.220,3260] successful.
Nov 27 04:01:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b917a-abde-4d18-a206-f9bf006855f7]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc38ec4-140b-4ff1-b1a3-7a78ff22ebd0]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c (non-flash)
Nov 27 04:01:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c (non-flash)
Nov 27 04:01:32 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a271a2e-51d5-4e18-a604-4b2404a23d76]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:32 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:01:33 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:01:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTWPuKBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:01:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:01:33 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23531623163313933', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:01:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531623163313933', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:01:33 user nova-compute[75006]: DEBUG nova.objects.instance [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:01:33 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:01:33 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:01:33 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:01:33 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:01:33 user nova-compute[75006]:   <serial>787ac1dc-e012-4d82-9a3f-93eecd7c862c</serial>
Nov 27 04:01:33 user nova-compute[75006]: </disk>
Nov 27 04:01:33 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:01:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:01:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:01:34 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No VIF found with MAC fa:16:3e:1e:de:6b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:01:34 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-d3616a60-f2d6-49a2-9a6c-6502c216c949 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.672s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:01:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:01:36 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:01:36 user nova-compute[75006]: INFO nova.compute.manager [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Detaching volume 787ac1dc-e012-4d82-9a3f-93eecd7c862c
Nov 27 04:01:36 user nova-compute[75006]: INFO nova.virt.block_device [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attempting to driver detach volume 787ac1dc-e012-4d82-9a3f-93eecd7c862c from mountpoint /dev/vdb
Nov 27 04:01:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Attempting to detach device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:01:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:01:36 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:01:36 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:01:36 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:01:36 user nova-compute[75006]:   <serial>787ac1dc-e012-4d82-9a3f-93eecd7c862c</serial>
Nov 27 04:01:36 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:01:36 user nova-compute[75006]: </disk>
Nov 27 04:01:36 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:01:36 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully detached device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the persistent domain config.
Nov 27 04:01:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf37ecbf-497b-494f-a969-98052f650e54 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:01:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:01:36 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:01:36 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:01:36 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:01:36 user nova-compute[75006]:   <serial>787ac1dc-e012-4d82-9a3f-93eecd7c862c</serial>
Nov 27 04:01:36 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:01:36 user nova-compute[75006]: </disk>
Nov 27 04:01:36 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:01:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:01:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:01:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:01:56 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf37ecbf-497b-494f-a969-98052f650e54 is timed out.
Nov 27 04:01:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully detached device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the live domain config.
Nov 27 04:01:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTWPuKBj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:01:56 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:01:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d01ff-43a1-4b73-b044-2f9bc5fd0862]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:01:56 user nova-compute[75006]: No targets found.
Nov 27 04:01:56 user nova-compute[75006]: iSNS:
Nov 27 04:01:56 user nova-compute[75006]: No targets found.
Nov 27 04:01:56 user nova-compute[75006]: STATIC:
Nov 27 04:01:56 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c
Nov 27 04:01:56 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:01:56 user nova-compute[75006]:                 Iface Name: default
Nov 27 04:01:56 user nova-compute[75006]: FIRMWARE:
Nov 27 04:01:56 user nova-compute[75006]: No targets found.
Nov 27 04:01:56 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:01:56 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:01:56 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ff7a84-9453-4c5f-bc45-4a49c33c297d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:56 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b26b72-a979-4b13-82a0-c9311efcbbb7]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c (non-flash)
Nov 27 04:01:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c (non-flash)
Nov 27 04:01:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd400746f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[70de9066-b6e8-433d-87b4-695cb3e95d7d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[22458acf-6770-4b05-83be-ff3162d8e998]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab08965b-1627-44f3-a73b-bac48f3d826e]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[70457cdb-7961-49f5-9e7d-51017aa05700]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a62ad71-54f7-4af5-882e-d2e5c5789e7c]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[df141ecc-9045-4ebb-91a0-8106d7e0222d]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c, portal: 172.16.0.220,3260]
Nov 27 04:01:57 user nova-compute[75006]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c, portal: 172.16.0.220,3260] successful.
Nov 27 04:01:57 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:787ac1dc-e012-4d82-9a3f-93eecd7c862c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc01e543-ed1b-4fd2-afcd-430b6ee381dd]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== disconnect_volume: return (321ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:01:57 user nova-compute[75006]: DEBUG nova.objects.instance [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:01:58 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-5e93560d-2cb1-4901-a06a-86bfac48b2db tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:02:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:02:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:02:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:02:18 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:02:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:02:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:02:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:02:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:02:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:02:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:02:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:02:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:02:22 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:02:23 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:02:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:02:23 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:02:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:02:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:27 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:02:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:02:27 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:02:27 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:02:27 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:28 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:02:28 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:02:28 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=25.090839385986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance bf37ecbf-497b-494f-a969-98052f650e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:02:28 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:02:29 user nova-compute[75006]: INFO nova.compute.manager [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attaching volume 23078639-e90d-421c-9dec-546561d67fa0 to /dev/vdb
Nov 27 04:02:29 user nova-compute[75006]: DEBUG os_brick.utils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bc2ac9-d88f-4ea8-bcb5-d9bd512d3abb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ec1782e8ead9\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb2e24e-bb61-4587-bff2-d4cf8684b566]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f00293-8c08-4fcb-9a11-ef88372d0e76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcac706-b0dd-4456-a8f3-32df4f15108d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Running cmd (subprocess): nvme version {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] 'nvme version' failed. Not Retrying. {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] nvme not present on system {{(pid=75006) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 04:02:29 user nova-compute[75006]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 04:02:29 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1bda55-7f41-4e7e-a24c-3948e4ee3f0b]: (4, '') {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75006) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.lightos [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] LIGHTOS: no hostnqn found. {{(pid=75006) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG os_brick.utils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ec1782e8ead9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:02:29 user nova-compute[75006]: DEBUG nova.virt.block_device [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating existing volume attachment record: 995678e1-30cd-4854-bb78-408c95cb5229 {{(pid=75006) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 04:02:30 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:31 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:31 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Calling os-brick to attach iSCSI Volume {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkqizpeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:02:35 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:02:35 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:02:35 user nova-compute[75006]: INFO os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a7097d-0012-4b48-a3bc-227cc71b370e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 04:02:35 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[6058cce3-2889-4330-bfd0-1e03ad0da030]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0] added\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0] added
Nov 27 04:02:35 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a6dbf-2d2f-4a5d-8b06-d81de006da8f]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[714bfe02-cb4e-4b0b-a10c-156467469d64]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkqizpeN {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GkqizpeN" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d36475-1da5-4001-bce1-a08ea2966465]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GkqizpeN'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4e9bd3-2123-44c7-84ff-5603434211d0]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea427ba-084f-4a75-bcd3-7528a644547b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:02:35 user nova-compute[75006]:  {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 04:02:35 user nova-compute[75006]:  {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:02:35 user nova-compute[75006]: WARNING os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 04:02:35 user nova-compute[75006]: 
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --login {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7986b0-2c15-43e9-959e-91012fbf9630]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0, portal: 172.16.0.220,3260]
Nov 27 04:02:35 user nova-compute[75006]: Login to [iface: default, target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0, portal: 172.16.0.220,3260] successful.
Nov 27 04:02:35 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b32793a-59f1-4f37-8f16-abb282841cb3]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7c43b3-3df2-4f18-899f-cb16dd009159]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 (non-flash)
Nov 27 04:02:35 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 (non-flash)
Nov 27 04:02:35 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Connected to 172.16.0.220:3260 {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75006) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75006) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f76b1f1-8e2c-472f-9a71-90935c324650]: (4, ('- - 0', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75006) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 04:02:35 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkqizpeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75006) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 04:02:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:36 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:02:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:02:36 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23433333861303333', 'path': '/dev/sdb'} {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:02:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433333861303333', 'path': '/dev/sdb'} {{(pid=75006) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 04:02:36 user nova-compute[75006]: DEBUG nova.objects.instance [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:02:36 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 04:02:36 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:02:36 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:02:36 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:02:36 user nova-compute[75006]:   <serial>23078639-e90d-421c-9dec-546561d67fa0</serial>
Nov 27 04:02:36 user nova-compute[75006]: </disk>
Nov 27 04:02:36 user nova-compute[75006]:  {{(pid=75006) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 04:02:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vda, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:02:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75006) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 04:02:37 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] No VIF found with MAC fa:16:3e:1e:de:6b, not building metadata {{(pid=75006) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 04:02:37 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-8e466c5a-acd6-4a56-adf0-feb2dd621848 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.675s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:02:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:02:39 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:02:39 user nova-compute[75006]: INFO nova.compute.manager [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Detaching volume 23078639-e90d-421c-9dec-546561d67fa0
Nov 27 04:02:40 user nova-compute[75006]: INFO nova.virt.block_device [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Attempting to driver detach volume 23078639-e90d-421c-9dec-546561d67fa0 from mountpoint /dev/vdb
Nov 27 04:02:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Attempting to detach device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the persistent domain config. {{(pid=75006) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 04:02:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:02:40 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:02:40 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:02:40 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:02:40 user nova-compute[75006]:   <serial>23078639-e90d-421c-9dec-546561d67fa0</serial>
Nov 27 04:02:40 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:02:40 user nova-compute[75006]: </disk>
Nov 27 04:02:40 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:02:40 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully detached device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the persistent domain config.
Nov 27 04:02:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf37ecbf-497b-494f-a969-98052f650e54 from the live domain config. {{(pid=75006) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 04:02:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.guest [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 04:02:40 user nova-compute[75006]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 04:02:40 user nova-compute[75006]:   <source dev="/dev/sdb"/>
Nov 27 04:02:40 user nova-compute[75006]:   <target dev="vdb" bus="virtio"/>
Nov 27 04:02:40 user nova-compute[75006]:   <serial>23078639-e90d-421c-9dec-546561d67fa0</serial>
Nov 27 04:02:40 user nova-compute[75006]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 04:02:40 user nova-compute[75006]: </disk>
Nov 27 04:02:40 user nova-compute[75006]:  {{(pid=75006) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 04:02:40 user nova-compute[75006]: DEBUG nova.virt.libvirt.driver [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 04:02:40 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:02:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:02:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:02:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:02:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:02:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:02:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:00 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bf37ecbf-497b-494f-a969-98052f650e54 is timed out.
Nov 27 04:03:00 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully detached device vdb from instance bf37ecbf-497b-494f-a969-98052f650e54 from the live domain config.
Nov 27 04:03:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] calling os-brick to detach iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd42473a6b0>, {'target_iqn': 'iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GkqizpeN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 04:03:00 user nova-compute[75006]: WARNING os_brick.initiator.connectors.base [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bcb193-d52b-44b7-a40b-bb67c39042f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 04:03:00 user nova-compute[75006]: No targets found.
Nov 27 04:03:00 user nova-compute[75006]: iSNS:
Nov 27 04:03:00 user nova-compute[75006]: No targets found.
Nov 27 04:03:00 user nova-compute[75006]: STATIC:
Nov 27 04:03:00 user nova-compute[75006]: Target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0
Nov 27 04:03:00 user nova-compute[75006]:         Portal: 172.16.0.220:3260,-1
Nov 27 04:03:00 user nova-compute[75006]:                 Iface Name: default
Nov 27 04:03:00 user nova-compute[75006]: FIRMWARE:
Nov 27 04:03:00 user nova-compute[75006]: No targets found.
Nov 27 04:03:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 04:03:00 user nova-compute[75006]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 04:03:00 user nova-compute[75006]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75006) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0', 0)] {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf9e2cf-5443-4da3-afa3-077b49e0495b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[66044018-3019-4ec4-8bf2-2966dd688865]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 (non-flash)\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 (non-flash)
Nov 27 04:03:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 (non-flash)
Nov 27 04:03:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd400744d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0'): ({'sdb'}, set())}) {{(pid=75006) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Removing single pathed devices sdb {{(pid=75006) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a639ad7-ba7b-465b-a007-3a492714c387]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4af1bdb-bfac-41d5-87c9-ef3487635036]: (4, ('ok\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Flushing IO for device /dev/sdb {{(pid=75006) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2a8061-7a5e-4f94-aced-eeb329a47d2d]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75006) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f99b0b-71b6-4aa2-9ec6-d165b75d2d08]: (4, ('1', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.linuxscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] SCSI volumes sdb have been removed. {{(pid=75006) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0')] {{(pid=75006) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba6b7ff-d46e-49a2-8da3-9a561883e3c1]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --logout {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[60da4cf5-0939-451a-bb13-23bd890cff7c]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0, portal: 172.16.0.220,3260]
Nov 27 04:03:00 user nova-compute[75006]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0, portal: 172.16.0.220,3260] successful.
Nov 27 04:03:00 user nova-compute[75006]:  stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op delete {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23078639-e90d-421c-9dec-546561d67fa0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85775) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG oslo.privsep.daemon [-] privsep: reply[552ac8c7-2975-49a7-b2ed-95c8a191fb23]: (4, ('', '')) {{(pid=85775) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75006) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.base [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] <== disconnect_volume: return (265ms) None {{(pid=75006) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 04:03:00 user nova-compute[75006]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Disconnected iSCSI Volume {{(pid=75006) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 04:03:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:01 user nova-compute[75006]: DEBUG nova.objects.instance [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'flavor' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:03:01 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ab7b0d6c-d628-4543-ac31-352fc9031ed3 tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.547s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:03:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:03:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:03:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:03:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:19 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:03:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:03:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:03:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:03:22 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:03:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 04:03:22 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquired lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 04:03:22 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Forcefully refreshing network info cache for instance {{(pid=75006) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 04:03:22 user nova-compute[75006]: DEBUG nova.objects.instance [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lazy-loading 'info_cache' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:03:23 user nova-compute[75006]: DEBUG nova.network.neutron [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [{"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:03:23 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Releasing lock "refresh_cache-bf37ecbf-497b-494f-a969-98052f650e54" {{(pid=75006) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 04:03:23 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updated the network info_cache for instance {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 04:03:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:29 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:29 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:03:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:03:29 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:03:29 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:03:29 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG oslo_concurrency.processutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75006) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 04:03:30 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:03:30 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:03:30 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.089946746826172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Instance bf37ecbf-497b-494f-a969-98052f650e54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75006) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:03:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:03:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:32 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:32 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:03:33 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:03:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:03:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:03:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:03:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:03:55 user nova-compute[75006]: INFO nova.compute.manager [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Terminating instance
Nov 27 04:03:55 user nova-compute[75006]: DEBUG nova.compute.manager [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Start destroying the instance on the hypervisor. {{(pid=75006) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-2abba150-b575-4b26-81cf-0597a206d4b0 req-06cdc7d4-0748-40bc-911d-6315b9483e53 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received event network-vif-unplugged-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2abba150-b575-4b26-81cf-0597a206d4b0 req-06cdc7d4-0748-40bc-911d-6315b9483e53 service nova] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2abba150-b575-4b26-81cf-0597a206d4b0 req-06cdc7d4-0748-40bc-911d-6315b9483e53 service nova] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-2abba150-b575-4b26-81cf-0597a206d4b0 req-06cdc7d4-0748-40bc-911d-6315b9483e53 service nova] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-2abba150-b575-4b26-81cf-0597a206d4b0 req-06cdc7d4-0748-40bc-911d-6315b9483e53 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] No waiting events found dispatching network-vif-unplugged-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:03:55 user nova-compute[75006]: DEBUG nova.compute.manager [req-2abba150-b575-4b26-81cf-0597a206d4b0 req-06cdc7d4-0748-40bc-911d-6315b9483e53 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received event network-vif-unplugged-903d03a0-c67d-42e1-90c6-1643887466c8 for instance with task_state deleting. {{(pid=75006) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [-] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Instance destroyed successfully.
Nov 27 04:03:56 user nova-compute[75006]: DEBUG nova.objects.instance [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lazy-loading 'resources' on Instance uuid bf37ecbf-497b-494f-a969-98052f650e54 {{(pid=75006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG nova.virt.libvirt.vif [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T03:57:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1777510412',display_name='tempest-SnapshotDataIntegrityTests-server-1777510412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1777510412',id=53,image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNqid5F03p5BvXyHmZ7bD6v83eio40VIme2S3ol7bQimVz4f7sN5CZ5EbTwQoi0ycl2zz+eLTLAjf7asGpNCCEROz10xbc5sVhRll9t9OjdsezoQDYkmrIBnOu9y6Tmgw==',key_name='tempest-keypair-25635503',keypairs=<?>,launch_index=0,launched_at=2023-11-27T03:57:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bdf39676a494b1593cc4c196f6f17f5',ramdisk_id='',reservation_id='r-bsttybxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e19384e9-bd8b-46ce-9cf0-3cac8b3d8868',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1094860346',owner_user_name='tempest-SnapshotDataIntegrityTests-1094860346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T03:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9b11e3819d624b6a9e03fee61d15c471',uuid=bf37ecbf-497b-494f-a969-98052f650e54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Converting VIF {"id": "903d03a0-c67d-42e1-90c6-1643887466c8", "address": "fa:16:3e:1e:de:6b", "network": {"id": "e6996cc1-91eb-443d-b785-7f5591a084a6", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-963938636-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bdf39676a494b1593cc4c196f6f17f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903d03a0-c6", "ovs_interfaceid": "903d03a0-c67d-42e1-90c6-1643887466c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG nova.network.os_vif_util [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:de:6b,bridge_name='br-int',has_traffic_filtering=True,id=903d03a0-c67d-42e1-90c6-1643887466c8,network=Network(e6996cc1-91eb-443d-b785-7f5591a084a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903d03a0-c6') {{(pid=75006) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG os_vif [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:de:6b,bridge_name='br-int',has_traffic_filtering=True,id=903d03a0-c67d-42e1-90c6-1643887466c8,network=Network(e6996cc1-91eb-443d-b785-7f5591a084a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903d03a0-c6') {{(pid=75006) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903d03a0-c6, bridge=br-int, if_exists=True) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65471588-a6a1-4e11-9f8f-b864c2c097e6) {{(pid=75006) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:03:56 user nova-compute[75006]: INFO os_vif [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:de:6b,bridge_name='br-int',has_traffic_filtering=True,id=903d03a0-c67d-42e1-90c6-1643887466c8,network=Network(e6996cc1-91eb-443d-b785-7f5591a084a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903d03a0-c6')
Nov 27 04:03:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Deleting instance files /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54_del
Nov 27 04:03:56 user nova-compute[75006]: INFO nova.virt.libvirt.driver [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Deletion of /opt/stack/data/nova/instances/bf37ecbf-497b-494f-a969-98052f650e54_del complete
Nov 27 04:03:56 user nova-compute[75006]: INFO nova.compute.manager [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 27 04:03:56 user nova-compute[75006]: DEBUG oslo.service.loopingcall [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75006) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG nova.compute.manager [-] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Deallocating network for instance {{(pid=75006) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 04:03:56 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: bf37ecbf-497b-494f-a969-98052f650e54] deallocate_for_instance() {{(pid=75006) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG nova.network.neutron [-] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Updating instance_info_cache with network_info: [] {{(pid=75006) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 04:03:57 user nova-compute[75006]: INFO nova.compute.manager [-] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Took 0.65 seconds to deallocate network for instance.
Nov 27 04:03:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-4d28b383-9aa3-4a09-8992-b38132405a59 req-88d3507d-f883-4080-8368-8a1294e3ca0f service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received event network-vif-deleted-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:03:57 user nova-compute[75006]: INFO nova.scheduler.client.report [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Deleted allocations for instance bf37ecbf-497b-494f-a969-98052f650e54
Nov 27 04:03:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-ecb64573-5a1d-4eaa-985f-72444b945dbb tempest-SnapshotDataIntegrityTests-1094860346 tempest-SnapshotDataIntegrityTests-1094860346-project-member] Lock "bf37ecbf-497b-494f-a969-98052f650e54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-aa5041f8-e2a8-48eb-94fe-271e940b6e91 req-a8d2c450-53bd-456b-859d-b2475a53fc50 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received event network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa5041f8-e2a8-48eb-94fe-271e940b6e91 req-a8d2c450-53bd-456b-859d-b2475a53fc50 service nova] Acquiring lock "bf37ecbf-497b-494f-a969-98052f650e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa5041f8-e2a8-48eb-94fe-271e940b6e91 req-a8d2c450-53bd-456b-859d-b2475a53fc50 service nova] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [req-aa5041f8-e2a8-48eb-94fe-271e940b6e91 req-a8d2c450-53bd-456b-859d-b2475a53fc50 service nova] Lock "bf37ecbf-497b-494f-a969-98052f650e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:03:57 user nova-compute[75006]: DEBUG nova.compute.manager [req-aa5041f8-e2a8-48eb-94fe-271e940b6e91 req-a8d2c450-53bd-456b-859d-b2475a53fc50 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] No waiting events found dispatching network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 {{(pid=75006) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 04:03:57 user nova-compute[75006]: WARNING nova.compute.manager [req-aa5041f8-e2a8-48eb-94fe-271e940b6e91 req-a8d2c450-53bd-456b-859d-b2475a53fc50 service nova] [instance: bf37ecbf-497b-494f-a969-98052f650e54] Received unexpected event network-vif-plugged-903d03a0-c67d-42e1-90c6-1643887466c8 for instance with vm_state deleted and task_state None.
Nov 27 04:04:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:04:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:04:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:04:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:04:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:04:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:04:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:04:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:04:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:04:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:21 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:23 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:23 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:04:23 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:04:23 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 04:04:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:30 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:04:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:04:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:04:30 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:04:31 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:04:31 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=25.117027282714844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing inventories for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating ProviderTree inventory for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Updating inventory in ProviderTree for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing aggregate associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, aggregates: None {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Refreshing trait associations for resource provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd, traits: COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI {{(pid=75006) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:04:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:04:32 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:32 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:32 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:04:33 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:35 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:36 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:36 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75006) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 04:04:39 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:04:44 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Cleaning up deleted instances {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 04:04:44 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] There are 0 instances to clean {{(pid=75006) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 04:04:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:04:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:04:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:04:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:04:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:49 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:04:49 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:53 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:04:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:05:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:05:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:05:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:05:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:05:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:22 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:24 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:25 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:25 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Starting heal instance info cache {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 04:05:25 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Rebuilding the list of instances to heal {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 04:05:25 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Didn't find any instances for network info cache update. {{(pid=75006) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 04:05:26 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:28 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:30 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:05:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:05:30 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:05:30 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75006) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 04:05:31 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:05:31 user nova-compute[75006]: WARNING nova.virt.libvirt.driver [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 04:05:31 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Hypervisor/Node resource view: name=user free_ram=9247MB free_disk=25.108951568603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75006) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75006) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG nova.compute.provider_tree [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed in ProviderTree for provider: b7ca9733-4bfc-461c-abb4-2c38c7e215cd {{(pid=75006) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG nova.scheduler.client.report [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Inventory has not changed for provider b7ca9733-4bfc-461c-abb4-2c38c7e215cd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75006) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG nova.compute.resource_tracker [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Compute_service record updated for user:user {{(pid=75006) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG oslo_concurrency.lockutils [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75006) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 04:05:31 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:05:32 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:33 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:33 user nova-compute[75006]: DEBUG nova.compute.manager [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75006) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 04:05:34 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:35 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:05:36 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:05:41 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:46 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:51 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:05:56 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:06:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:06:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:06:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:06:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:06:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:06:01 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:06:06 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:06:11 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:06:16 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:06:20 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:06:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 04:06:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:06:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75006) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 04:06:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:06:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75006) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 04:06:21 user nova-compute[75006]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75006) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 04:06:24 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 04:06:24 user nova-compute[75006]: DEBUG oslo_service.periodic_task [None req-aef4062c-3a79-442d-88e7-c6fa1aa78eb2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75006) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}